[ 533.106593] env[65585]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 533.106593] env[65585]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 534.100313] env[65678]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 534.100313] env[65678]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 535.654544] env[65678]: INFO neutron.common.config [-] Logging enabled! [ 535.654965] env[65678]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev113 [ 535.655110] env[65678]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65678) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 535.655413] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 535.655514] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 535.656327] env[65678]: WARNING oslo_policy.policy [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 535.656538] env[65678]: WARNING oslo_policy.policy [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 535.658178] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] VMware NSXv3 Agent initialized successfully. [ 535.658531] env[65678]: DEBUG oslo_concurrency.lockutils [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] Acquiring lock "singleton_lock" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.658638] env[65678]: DEBUG oslo_concurrency.lockutils [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] Acquired lock "singleton_lock" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.658845] env[65678]: DEBUG oslo_concurrency.lockutils [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] Releasing lock "singleton_lock" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.659140] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] Full set of CONF: {{(pid=65678) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:274}} [ 535.659251] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ******************************************************************************** {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 535.659350] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] Configuration options gathered from: {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 535.659674] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 535.659843] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 535.659948] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ================================================================================ {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 535.660122] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] agent_down_time = 75 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.660260] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] allow_automatic_dhcp_failover = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.660397] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] allow_bulk = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.660549] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] api_extensions_path = {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.660688] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] api_paste_config = api-paste.ini {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.660821] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] auth_strategy = keystone {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.660922] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] backdoor_port = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.661031] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] backdoor_socket = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.661160] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] backlog = 4096 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.661295] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.661442] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] bind_host = 0.0.0.0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.661580] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] bind_port = 9696 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.661712] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] client_socket_timeout = 900 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.661847] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] config_dir = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.661980] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.662095] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] config_source = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.662232] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] control_exchange = neutron {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.662373] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] core_plugin = ml2 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.662528] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] debug = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.662659] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] default_availability_zones = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.662868] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.663014] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] dhcp_agent_notification = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.663156] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] dhcp_agents_per_network = 1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.663286] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] dhcp_lease_duration = 86400 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.663423] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] dhcp_load_type = networks {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.663558] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] dns_domain = openstacklocal {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.663717] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.663853] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] enable_default_route_bfd = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.663983] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] enable_default_route_ecmp = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.664125] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] enable_dvr = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.664418] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] enable_new_agents = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.664418] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.664506] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] enable_signals = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.664626] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] enable_traditional_dhcp = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.664749] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] external_dns_driver = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.664877] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] filter_validation = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.665027] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] global_physnet_mtu = 8950 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.665154] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] graceful_shutdown_timeout = 60 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.665323] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] host = cpu-1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.665457] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] host_dvr_for_dhcp = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.665585] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] http_retries = 3 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.665720] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] instance_format = [instance: %(uuid)s] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.665855] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.665986] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ipam_driver = internal {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.666127] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ipv6_pd_enabled = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.666253] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] l3_ha = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.666384] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.666519] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] l3_ha_network_physical_name = {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.666648] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] l3_ha_network_type = {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.666782] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] log_color = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.666948] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] log_config_append = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.667050] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.667208] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] log_dir = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.667297] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] log_file = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.667396] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] log_options = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.667525] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] log_rotate_interval = 1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.667661] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] log_rotate_interval_type = days {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.667791] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] log_rotation_type = none {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.667892] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.667991] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.668138] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.668267] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.668367] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.668496] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] max_dns_nameservers = 5 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.668625] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] max_header_line = 16384 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.668753] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] max_l3_agents_per_router = 3 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.668878] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] max_logfile_count = 30 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.669024] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] max_logfile_size_mb = 200 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.669140] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] max_subnet_host_routes = 20 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.669271] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] my_ip = 10.180.1.21 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.669402] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] my_ipv6 = ::1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.669525] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] network_auto_schedule = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.669648] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] network_link_prefix = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.669780] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.669915] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] notify_nova_on_port_data_changes = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.670060] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] notify_nova_on_port_status_changes = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.670198] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] pagination_max_limit = -1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.670325] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] publish_errors = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.670477] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] rate_limit_burst = 0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.670627] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] rate_limit_except_level = CRITICAL {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.670759] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] rate_limit_interval = 0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.670885] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] retry_until_window = 30 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.671018] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] router_distributed = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.671150] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] rpc_resources_processing_step = 20 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.671306] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] rpc_response_max_timeout = 600 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.671437] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] rpc_response_timeout = 60 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.671629] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] send_events_interval = 2 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.671797] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] service_plugins = ['router'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.671937] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] setproctitle = on {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.672128] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] shell_completion = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.672239] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] state_path = /opt/stack/data/neutron {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.672394] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] syslog_log_facility = LOG_USER {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.672570] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] tcp_keepidle = 600 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.672743] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] transport_url = **** {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.672881] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] use_journal = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.673018] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] use_json = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.673149] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] use_ssl = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.673278] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] use_stderr = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.673413] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] use_syslog = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.673540] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] vlan_qinq = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.673761] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] vlan_transparent = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.673825] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] watch_log_file = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.673944] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] wsgi_default_pool_size = 100 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.674086] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] wsgi_keep_alive = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.674229] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.674361] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] wsgi_server_debug = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.674510] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_concurrency.disable_process_locking = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.674654] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.674891] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.674953] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.675076] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.675212] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.675399] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.675563] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.connection_string = messaging:// {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.675705] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.enabled = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.675842] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.es_doc_type = notification {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.675973] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.es_scroll_size = 10000 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.676119] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.es_scroll_time = 2m {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.676253] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.filter_error_trace = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.676387] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.hmac_keys = **** {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.676522] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.sentinel_service_name = mymaster {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.676663] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.socket_timeout = 0.1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.676821] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.trace_requests = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.676959] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler.trace_sqlalchemy = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.677152] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler_jaeger.process_tags = {} {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.677288] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler_jaeger.service_name_prefix = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.677421] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] profiler_otlp.service_name_prefix = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.677595] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.enforce_new_defaults = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.677875] env[65678]: WARNING oslo_config.cfg [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 535.678037] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.enforce_scope = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.678183] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.policy_default_rule = default {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.678333] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.678472] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.678611] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.678743] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.678870] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.678998] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.679140] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.679277] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.679426] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.679571] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] agent.extensions = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.679715] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.679856] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] service_providers.service_provider = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.680007] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.default_quota = -1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.680155] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.680287] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.quota_floatingip = 50 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.680434] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.quota_network = 100 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.680576] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.quota_port = 500 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.680705] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.680835] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.quota_router = 10 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.680962] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.quota_security_group = 10 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.681105] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.681235] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.quota_subnet = 100 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.681364] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] QUOTAS.track_quota_usage = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.681510] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.681641] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep.group = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.681768] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep.helper_command = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.681900] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep.log_daemon_traceback = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.682050] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.682182] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep.thread_pool_size = 8 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.682307] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep.user = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.682448] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.682612] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_dhcp_release.group = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.682725] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_dhcp_release.helper_command = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.682885] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.683033] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.683166] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.683328] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_dhcp_release.user = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.683476] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.683603] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_ovs_vsctl.group = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.683753] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.683896] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.684042] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.684174] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.684325] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_ovs_vsctl.user = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.684474] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_namespace.capabilities = [21] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.684603] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_namespace.group = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.684730] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_namespace.helper_command = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.684888] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.685035] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.685168] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.685294] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_namespace.user = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.685430] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_conntrack.capabilities = [12] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.685557] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_conntrack.group = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.685685] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_conntrack.helper_command = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.685815] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.685946] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.686090] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.686219] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_conntrack.user = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.686358] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_link.capabilities = [12, 21] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.686484] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_link.group = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.686609] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_link.helper_command = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.686741] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_link.log_daemon_traceback = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.686874] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.687011] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_link.thread_pool_size = 8 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.687142] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] privsep_link.user = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.687292] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.687430] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.687565] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.continue_on_failed_promotions = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.687700] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.dscp = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.687834] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.dscp_inherit = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.687971] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.force_mp_to_policy = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.688114] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.locking_coordinator_url = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.688248] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.log_agent_heartbeats = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.688380] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.logging_expire = 1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.688517] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.688652] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.688791] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.polling_interval = 240 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.688925] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.689074] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.689219] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.report_interval = 30.0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.689358] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.689495] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.689631] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.689796] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.sync_skew = 60 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.689891] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.synchronization_queue_size = 20 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.690033] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT.use_helper_for_ns_read = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.690218] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] SECURITYGROUP.enable_ipset = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.690310] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] SECURITYGROUP.enable_security_group = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.690481] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.690651] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.690796] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] experimental.ipv6_pd_enabled = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.691013] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ml2.extension_drivers = ['port_security'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.691173] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ml2.external_network_type = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.691325] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.691467] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ml2.overlay_ip_version = 4 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.691607] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ml2.path_mtu = 8950 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.691748] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ml2.physical_network_mtus = {} {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.691890] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.692036] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.692179] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ml2.type_drivers = ['vlan'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.692322] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.692453] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.692610] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.692763] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.692901] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.693050] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.693194] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.693334] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.693475] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.693671] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.693817] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_login_password = **** {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.693960] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.694109] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_login_user = admin {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.694247] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.694387] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.694520] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.694672] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.694818] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.694959] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.695108] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.695244] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.695375] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.695513] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.695657] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.695790] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.695925] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.696134] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.696280] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.696419] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.696555] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.696695] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.auth_section = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.696892] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.auth_type = password {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.697071] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.697207] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.certfile = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.697343] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.collect_timing = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.697483] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.endpoint_type = public {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.697617] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.insecure = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.697747] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.keyfile = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.697885] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.region_name = RegionOne {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.698026] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.split_loggers = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.698151] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] nova.timeout = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.698289] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.auth_section = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.698428] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.auth_type = password {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.698566] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.698702] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.certfile = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.698836] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.collect_timing = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.698974] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.endpoint_type = public {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.699119] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.insecure = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.699246] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.keyfile = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.699370] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.region_name = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.699499] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.split_loggers = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.699626] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] placement.timeout = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.699760] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.auth_section = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.699925] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.auth_type = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.700072] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.cafile = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.700203] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.certfile = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.700335] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.collect_timing = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.700509] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.connect_retries = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.700659] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.connect_retry_delay = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.700793] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.enable_notifications = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.700921] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.endpoint_override = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.701070] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.insecure = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.701199] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.interface = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.701325] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.keyfile = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.701456] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.max_version = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.701583] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.min_version = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.701712] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.region_name = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.701840] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.retriable_status_codes = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.701964] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.service_name = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.702104] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.service_type = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.702236] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.split_loggers = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.702363] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.status_code_retries = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.702491] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.status_code_retry_delay = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.702650] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.timeout = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.702868] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.valid_interfaces = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.702935] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ironic.version = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.703125] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] cli_script.dry_run = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.703250] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.703384] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.703518] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.703649] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.703783] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.703914] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.704052] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.704187] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.704316] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.704457] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.704586] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.704724] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.704861] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.704996] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.705144] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.705281] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.705410] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.705540] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.705679] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.705899] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.706083] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.706224] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.706356] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.706485] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.706613] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.706740] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.706865] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.706992] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.707132] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.707259] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.707391] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.ssl = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.707529] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.707665] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.707795] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.707929] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.708073] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.708205] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.708349] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_notifications.driver = [] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.708482] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_notifications.retry = -1 {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.708627] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.708760] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.708857] env[65678]: DEBUG oslo_service.backend._eventlet.service [None req-ce669adf-e549-44d7-af9a-737d450f6f13 None None] ******************************************************************************** {{(pid=65678) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 535.710033] env[65678]: DEBUG neutron.agent.securitygroups_rpc [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Init firewall settings (driver=nsxv3) {{(pid=65678) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 535.711358] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65678) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 535.711599] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] RPC agent_id: nsxm-l-01a.corp.local [ 535.713844] env[65678]: DEBUG dogpile.cache.region [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 535.713963] env[65678]: DEBUG dogpile.lock [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 535.714075] env[65678]: DEBUG dogpile.lock [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 535.714166] env[65678]: DEBUG dogpile.lock [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 535.714259] env[65678]: DEBUG dogpile.cache.region [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 535.714346] env[65678]: DEBUG dogpile.lock [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 535.714465] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 535.765650] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Session token - acquiring [ 535.767651] env[65678]: DEBUG networking_nsxv3.common.locking [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.767884] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.767949] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.768394] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.780802] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.117021] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 536.140805] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 536.141023] env[65678]: DEBUG dogpile.cache.region [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Cache value generated in 0.426 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 536.141066] env[65678]: DEBUG dogpile.lock [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 536.141197] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Activating Policy API Provider. [ 536.141389] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Looking for the default Infrastructure Rules. [ 536.211365] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Looking for the Default Layer3 Logged Drop Section. [ 536.226691] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 536.227159] env[65678]: DEBUG networking_nsxv3.common.locking [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.227328] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquiring lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.227428] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.227705] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired external semaphore "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.228047] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.746217] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.248531] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.751125] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Inventory metadata is going to be refreshed. [ 537.751516] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 538.531895] env[65678]: DEBUG networking_nsxv3.common.locking [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.532231] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.532231] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.532528] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.543262] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 538.545541] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.546222] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 538.566979] env[65678]: DEBUG networking_nsxv3.common.locking [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.567261] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.567261] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.567553] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.567675] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.567814] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 538.567930] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.568122] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 538.590196] env[65678]: DEBUG networking_nsxv3.common.locking [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.590501] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.590501] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.590695] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.590871] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.591023] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 538.614183] env[65678]: DEBUG networking_nsxv3.common.locking [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.614474] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.614474] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.614736] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.614909] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.615063] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 538.634842] env[65678]: DEBUG networking_nsxv3.common.locking [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.635152] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquiring lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.635152] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.635412] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired external semaphore "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.635554] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Releasing lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.635701] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 538.635801] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.635902] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 538.655951] env[65678]: DEBUG networking_nsxv3.common.locking [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.656252] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquiring lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.656252] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.656547] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired external semaphore "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.656707] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Releasing lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.656847] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 538.656944] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.657057] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 538.677673] env[65678]: DEBUG networking_nsxv3.common.locking [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.678052] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.678052] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.678248] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.678388] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.678544] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 538.678670] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.678771] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Inventory metadata have been refreshed. [ 538.678866] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Dryrun:True. Metadata refresh completed. [ 538.678982] env[65678]: DEBUG oslo_concurrency.lockutils [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Releasing lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.680736] env[65678]: INFO neutron.agent.agent_extensions_manager [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Loaded agent extensions: [] [ 538.681455] env[65678]: DEBUG neutron_lib.callbacks.manager [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65678) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 538.739059] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent RPC Daemon Started! [ 538.739308] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent loop - iteration:0 started [ 538.739381] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent out of sync with plugin! [ 543.681722] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 543.682152] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 548.683287] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.683545] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.684876] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.685329] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.950067] env[65678]: INFO networking_nsxv3.common.synchronization [None req-0ac85e48-7ccd-4f00-b7a0-b1988c59ca10 demo admin] Enqueued Resource ID: d2a90010-b1e5-468b-9e61-b5e5c6c37c21 with Priority: HIGHEST for action security_group_rules [ 553.952041] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2a90010-b1e5-468b-9e61-b5e5c6c37c21 with Priority: HIGHEST for action security_group_rules [ 553.952342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2a90010-b1e5-468b-9e61-b5e5c6c37c21 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.952471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2a90010-b1e5-468b-9e61-b5e5c6c37c21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.952573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2a90010-b1e5-468b-9e61-b5e5c6c37c21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.952920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2a90010-b1e5-468b-9e61-b5e5c6c37c21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.952997] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2a90010-b1e5-468b-9e61-b5e5c6c37c21',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.474199] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.474449] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.474449] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.474635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.474718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.474816] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2a90010-b1e5-468b-9e61-b5e5c6c37c21 already deleted. [ 554.475127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2a90010-b1e5-468b-9e61-b5e5c6c37c21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.953027] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.953861] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.955229] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.955460] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.956765] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.957035] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.685802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.686210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.686210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.686210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.687714] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.957834] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 573.958091] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 574.191449] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.695163] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.201416] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 575.201658] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 575.976534] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.976888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.976888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.977017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.991873] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 575.992778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.993853] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 576.014997] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.015204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.015204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.015371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.015453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.015569] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 576.015639] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.015708] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 576.037989] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.038348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.038348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.038424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.038554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.040018] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 576.059756] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.060020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.060020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.060172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.060275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.060388] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 576.085281] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.085494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.085494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.085686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.085789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.085907] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 576.086044] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.086077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 576.115899] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.116159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.116159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.116304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.116383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.116487] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 576.116558] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.116734] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 576.137821] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.138182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.138182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.138320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.138368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.138445] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 576.138513] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.138578] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 576.138641] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 576.138728] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 576.138789] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 576.138849] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 576.139176] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 576.139276] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 576.139331] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 576.162691] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.162896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.163043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.163143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.163246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.163357] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 576.190577] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.190852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.190918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.191226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.191346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.206898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.500607] env[65678]: INFO networking_nsxv3.common.synchronization [None req-9188b04f-6cec-493a-a58d-843dd1f3bb04 None None] Enqueued Resource ID: 82e5ca71-af6e-47eb-9df8-670c4bf8dad0 with Priority: HIGHEST for action port [ 578.501221] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e5ca71-af6e-47eb-9df8-670c4bf8dad0 with Priority: HIGHEST for action port [ 578.501527] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-82e5ca71-af6e-47eb-9df8-670c4bf8dad0 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.501647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82e5ca71-af6e-47eb-9df8-670c4bf8dad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.501712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82e5ca71-af6e-47eb-9df8-670c4bf8dad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.501972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82e5ca71-af6e-47eb-9df8-670c4bf8dad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.502209] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e5ca71-af6e-47eb-9df8-670c4bf8dad0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.988559] env[65678]: INFO networking_nsxv3.common.synchronization [None req-d3ce6536-3cbe-433e-aa67-52721672e836 None None] Enqueued Resource ID: aba4dbaa-0e6d-45d1-9b05-9321c07385d9 with Priority: HIGHEST for action port [ 578.989140] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba4dbaa-0e6d-45d1-9b05-9321c07385d9 with Priority: HIGHEST for action port [ 578.989475] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-aba4dbaa-0e6d-45d1-9b05-9321c07385d9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.989668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aba4dbaa-0e6d-45d1-9b05-9321c07385d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.989668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aba4dbaa-0e6d-45d1-9b05-9321c07385d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.989847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aba4dbaa-0e6d-45d1-9b05-9321c07385d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.989929] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba4dbaa-0e6d-45d1-9b05-9321c07385d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.005914] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82e5ca71-af6e-47eb-9df8-670c4bf8dad0 [ 579.006161] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.006294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.006363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.006573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.006663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.006755] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82e5ca71-af6e-47eb-9df8-670c4bf8dad0 already deleted. [ 579.006836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82e5ca71-af6e-47eb-9df8-670c4bf8dad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.499608] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aba4dbaa-0e6d-45d1-9b05-9321c07385d9 [ 579.499843] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.499978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.500063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.500287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.500376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.500494] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aba4dbaa-0e6d-45d1-9b05-9321c07385d9 already deleted. [ 579.500607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aba4dbaa-0e6d-45d1-9b05-9321c07385d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.834516] env[65678]: INFO networking_nsxv3.common.synchronization [None req-9c3f2af8-fa5e-40f7-850b-7231a704a51f None None] Enqueued Resource ID: 31b9484a-d071-4875-b1a0-f0d30208f7f3 with Priority: HIGHEST for action port [ 580.834516] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b9484a-d071-4875-b1a0-f0d30208f7f3 with Priority: HIGHEST for action port [ 580.834516] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-31b9484a-d071-4875-b1a0-f0d30208f7f3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.834516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31b9484a-d071-4875-b1a0-f0d30208f7f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.834516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31b9484a-d071-4875-b1a0-f0d30208f7f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.836491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31b9484a-d071-4875-b1a0-f0d30208f7f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.836806] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b9484a-d071-4875-b1a0-f0d30208f7f3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.135228] env[65678]: INFO networking_nsxv3.common.synchronization [None req-785beb4c-55ca-4971-956f-66879b293968 None None] Enqueued Resource ID: b739994b-6264-40ed-8cfa-53ae6afb7143 with Priority: HIGHEST for action port [ 581.135228] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b739994b-6264-40ed-8cfa-53ae6afb7143 with Priority: HIGHEST for action port [ 581.135674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b739994b-6264-40ed-8cfa-53ae6afb7143 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.136035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b739994b-6264-40ed-8cfa-53ae6afb7143" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.136035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b739994b-6264-40ed-8cfa-53ae6afb7143" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.136176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b739994b-6264-40ed-8cfa-53ae6afb7143" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.136246] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b739994b-6264-40ed-8cfa-53ae6afb7143',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.338875] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31b9484a-d071-4875-b1a0-f0d30208f7f3 [ 581.339126] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.339265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.339335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.339545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.339636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.339729] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31b9484a-d071-4875-b1a0-f0d30208f7f3 already deleted. [ 581.339812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31b9484a-d071-4875-b1a0-f0d30208f7f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.639416] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b739994b-6264-40ed-8cfa-53ae6afb7143 [ 581.639527] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.639632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.639708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.640490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.640490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.640490] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b739994b-6264-40ed-8cfa-53ae6afb7143 already deleted. [ 581.640490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b739994b-6264-40ed-8cfa-53ae6afb7143" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.960642] env[65678]: INFO networking_nsxv3.common.synchronization [None req-3643b49e-3214-4aed-b5cf-d5b793b39ccd None None] Enqueued Resource ID: 125323db-2d6c-4bd0-8920-6c48f0faae81 with Priority: HIGHEST for action port [ 583.961818] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 125323db-2d6c-4bd0-8920-6c48f0faae81 with Priority: HIGHEST for action port [ 583.962137] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-125323db-2d6c-4bd0-8920-6c48f0faae81 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.962349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-125323db-2d6c-4bd0-8920-6c48f0faae81" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.962467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-125323db-2d6c-4bd0-8920-6c48f0faae81" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.963154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-125323db-2d6c-4bd0-8920-6c48f0faae81" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.963154] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('125323db-2d6c-4bd0-8920-6c48f0faae81',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.465906] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 125323db-2d6c-4bd0-8920-6c48f0faae81 [ 584.466172] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.466635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.466635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.466635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.466760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.466760] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:125323db-2d6c-4bd0-8920-6c48f0faae81 already deleted. [ 584.466822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-125323db-2d6c-4bd0-8920-6c48f0faae81" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.565515] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e58feb6e-2efd-457b-bf4d-0e99bd52cc58 None None] Enqueued Resource ID: 08931196-21fd-4298-a72c-c1faa9ef0602 with Priority: HIGHEST for action port [ 584.565965] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08931196-21fd-4298-a72c-c1faa9ef0602 with Priority: HIGHEST for action port [ 584.566281] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-08931196-21fd-4298-a72c-c1faa9ef0602 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.566405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08931196-21fd-4298-a72c-c1faa9ef0602" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.566498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08931196-21fd-4298-a72c-c1faa9ef0602" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.566716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08931196-21fd-4298-a72c-c1faa9ef0602" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.566794] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08931196-21fd-4298-a72c-c1faa9ef0602',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.069574] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08931196-21fd-4298-a72c-c1faa9ef0602 [ 585.069856] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.071324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.071407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.071635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.071778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.071902] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08931196-21fd-4298-a72c-c1faa9ef0602 already deleted. [ 585.071991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08931196-21fd-4298-a72c-c1faa9ef0602" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.211462] env[65678]: INFO networking_nsxv3.common.synchronization [None req-6e94cbd7-c208-4f28-a168-1f7ac34796f5 None None] Enqueued Resource ID: a3b11b20-0edb-4fef-9acb-12f91059ef6f with Priority: HIGHEST for action port [ 586.213575] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b11b20-0edb-4fef-9acb-12f91059ef6f with Priority: HIGHEST for action port [ 586.213575] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3b11b20-0edb-4fef-9acb-12f91059ef6f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.213575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3b11b20-0edb-4fef-9acb-12f91059ef6f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.213575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3b11b20-0edb-4fef-9acb-12f91059ef6f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.213575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3b11b20-0edb-4fef-9acb-12f91059ef6f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.213575] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3b11b20-0edb-4fef-9acb-12f91059ef6f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.555820] env[65678]: INFO networking_nsxv3.common.synchronization [None req-c23bcf80-0dc5-46ed-a046-1ee8eec34014 None None] Enqueued Resource ID: 98dbe9b3-671f-4881-a6db-39396267e3e6 with Priority: HIGHEST for action port [ 586.556405] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98dbe9b3-671f-4881-a6db-39396267e3e6 with Priority: HIGHEST for action port [ 586.556732] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-98dbe9b3-671f-4881-a6db-39396267e3e6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.557248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98dbe9b3-671f-4881-a6db-39396267e3e6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.557248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98dbe9b3-671f-4881-a6db-39396267e3e6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.557248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98dbe9b3-671f-4881-a6db-39396267e3e6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.557248] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98dbe9b3-671f-4881-a6db-39396267e3e6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.715255] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3b11b20-0edb-4fef-9acb-12f91059ef6f [ 586.716250] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.716250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.716250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.716250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.716250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.716250] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3b11b20-0edb-4fef-9acb-12f91059ef6f already deleted. [ 586.716250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3b11b20-0edb-4fef-9acb-12f91059ef6f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.061016] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98dbe9b3-671f-4881-a6db-39396267e3e6 [ 587.061016] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.061016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.061016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.061016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.061016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.061016] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98dbe9b3-671f-4881-a6db-39396267e3e6 already deleted. [ 587.061016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98dbe9b3-671f-4881-a6db-39396267e3e6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.304945] env[65678]: INFO networking_nsxv3.common.synchronization [None req-3c229f1d-2cb2-45b2-b221-08b0ccc9654c None None] Enqueued Resource ID: 8c271fe1-2a64-4971-9fb1-644ec7ee98f8 with Priority: HIGHEST for action port [ 587.305241] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c271fe1-2a64-4971-9fb1-644ec7ee98f8 with Priority: HIGHEST for action port [ 587.305801] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c271fe1-2a64-4971-9fb1-644ec7ee98f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.305939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c271fe1-2a64-4971-9fb1-644ec7ee98f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.306017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c271fe1-2a64-4971-9fb1-644ec7ee98f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.306245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c271fe1-2a64-4971-9fb1-644ec7ee98f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.306326] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c271fe1-2a64-4971-9fb1-644ec7ee98f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.633298] env[65678]: INFO networking_nsxv3.common.synchronization [None req-dd4e2023-d3eb-4ff9-b1d5-785eeea345c1 None None] Enqueued Resource ID: 851f1538-2c36-4e3c-aa46-b97cc283051c with Priority: HIGHEST for action port [ 587.634093] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851f1538-2c36-4e3c-aa46-b97cc283051c with Priority: HIGHEST for action port [ 587.634563] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-851f1538-2c36-4e3c-aa46-b97cc283051c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.634662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-851f1538-2c36-4e3c-aa46-b97cc283051c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.634738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-851f1538-2c36-4e3c-aa46-b97cc283051c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.635161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-851f1538-2c36-4e3c-aa46-b97cc283051c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.635305] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('851f1538-2c36-4e3c-aa46-b97cc283051c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.810614] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c271fe1-2a64-4971-9fb1-644ec7ee98f8 [ 587.810614] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.810614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.810614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.810614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.810614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.810614] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c271fe1-2a64-4971-9fb1-644ec7ee98f8 already deleted. [ 587.810614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c271fe1-2a64-4971-9fb1-644ec7ee98f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.142082] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 851f1538-2c36-4e3c-aa46-b97cc283051c [ 588.142464] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.143410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.143410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.143410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.143410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.143410] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:851f1538-2c36-4e3c-aa46-b97cc283051c already deleted. [ 588.143410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-851f1538-2c36-4e3c-aa46-b97cc283051c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.647224] env[65678]: INFO networking_nsxv3.common.synchronization [None req-0ba74296-c371-41a0-91f1-2aaa3d63b1c9 None None] Enqueued Resource ID: 82889449-0ee9-46f6-b942-0fe9ac938cfb with Priority: HIGHEST for action port [ 588.647224] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82889449-0ee9-46f6-b942-0fe9ac938cfb with Priority: HIGHEST for action port [ 588.647224] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-82889449-0ee9-46f6-b942-0fe9ac938cfb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.647224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82889449-0ee9-46f6-b942-0fe9ac938cfb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.647224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82889449-0ee9-46f6-b942-0fe9ac938cfb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.647224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82889449-0ee9-46f6-b942-0fe9ac938cfb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.647224] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82889449-0ee9-46f6-b942-0fe9ac938cfb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.142332] env[65678]: INFO networking_nsxv3.common.synchronization [None req-c71a9a1a-f20f-4ce0-b6ad-2145a4e946c1 None None] Enqueued Resource ID: 33abfea8-261c-47d1-b902-fea600a1f115 with Priority: HIGHEST for action port [ 589.144318] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33abfea8-261c-47d1-b902-fea600a1f115 with Priority: HIGHEST for action port [ 589.144318] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-33abfea8-261c-47d1-b902-fea600a1f115 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.144318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33abfea8-261c-47d1-b902-fea600a1f115" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.144576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33abfea8-261c-47d1-b902-fea600a1f115" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.144654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33abfea8-261c-47d1-b902-fea600a1f115" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.144704] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33abfea8-261c-47d1-b902-fea600a1f115',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.149748] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82889449-0ee9-46f6-b942-0fe9ac938cfb [ 589.149960] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.150663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.150663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.150663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.150663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.150663] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82889449-0ee9-46f6-b942-0fe9ac938cfb already deleted. [ 589.150855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82889449-0ee9-46f6-b942-0fe9ac938cfb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.648113] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33abfea8-261c-47d1-b902-fea600a1f115 [ 589.648113] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.648113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.648113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.648464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.648464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.648464] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33abfea8-261c-47d1-b902-fea600a1f115 already deleted. [ 589.648464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33abfea8-261c-47d1-b902-fea600a1f115" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.771791] env[65678]: INFO networking_nsxv3.common.synchronization [None req-8e448c9b-d3a0-47e2-8409-f38caf414c99 None None] Enqueued Resource ID: 84e7811d-5694-4edb-8adf-5a496ca91994 with Priority: HIGHEST for action port [ 590.772735] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84e7811d-5694-4edb-8adf-5a496ca91994 with Priority: HIGHEST for action port [ 590.772735] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-84e7811d-5694-4edb-8adf-5a496ca91994 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.772988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84e7811d-5694-4edb-8adf-5a496ca91994" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.772988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84e7811d-5694-4edb-8adf-5a496ca91994" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.774691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84e7811d-5694-4edb-8adf-5a496ca91994" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.774792] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84e7811d-5694-4edb-8adf-5a496ca91994',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.278993] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84e7811d-5694-4edb-8adf-5a496ca91994 [ 591.280059] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.280059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.280059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.280059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.280059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.280059] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84e7811d-5694-4edb-8adf-5a496ca91994 already deleted. [ 591.280059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84e7811d-5694-4edb-8adf-5a496ca91994" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.330485] env[65678]: INFO networking_nsxv3.common.synchronization [None req-c95e0d4b-12c1-4889-96f8-50ea09d6d3b6 None None] Enqueued Resource ID: 41c88f17-a695-499b-b8d6-8af7950af9ac with Priority: HIGHEST for action port [ 591.331062] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c88f17-a695-499b-b8d6-8af7950af9ac with Priority: HIGHEST for action port [ 591.331698] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-41c88f17-a695-499b-b8d6-8af7950af9ac taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.331829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41c88f17-a695-499b-b8d6-8af7950af9ac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.331969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41c88f17-a695-499b-b8d6-8af7950af9ac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.332198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41c88f17-a695-499b-b8d6-8af7950af9ac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.332450] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41c88f17-a695-499b-b8d6-8af7950af9ac',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.774020] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e02c0a4a-fff9-4e6f-aee8-397be29e91c3 None None] Enqueued Resource ID: 468051f4-5186-4d99-8148-8f215e97d8ca with Priority: HIGHEST for action port [ 591.774020] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468051f4-5186-4d99-8148-8f215e97d8ca with Priority: HIGHEST for action port [ 591.774020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-468051f4-5186-4d99-8148-8f215e97d8ca taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.774426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-468051f4-5186-4d99-8148-8f215e97d8ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.774426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-468051f4-5186-4d99-8148-8f215e97d8ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.774426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-468051f4-5186-4d99-8148-8f215e97d8ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.774632] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('468051f4-5186-4d99-8148-8f215e97d8ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.834852] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41c88f17-a695-499b-b8d6-8af7950af9ac [ 591.834852] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.834852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.834852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.835211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.835211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.835211] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41c88f17-a695-499b-b8d6-8af7950af9ac already deleted. [ 591.835304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41c88f17-a695-499b-b8d6-8af7950af9ac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.279626] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 468051f4-5186-4d99-8148-8f215e97d8ca [ 592.280795] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.280795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.281880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.281880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.281880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.281880] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:468051f4-5186-4d99-8148-8f215e97d8ca already deleted. [ 592.281880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-468051f4-5186-4d99-8148-8f215e97d8ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.379460] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e70b03c4-3ec8-427b-9212-c5e7597406df None None] Enqueued Resource ID: b52f116e-6797-4985-8ed4-eae3640056df with Priority: HIGHEST for action port [ 593.379847] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b52f116e-6797-4985-8ed4-eae3640056df with Priority: HIGHEST for action port [ 593.380428] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b52f116e-6797-4985-8ed4-eae3640056df taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.380428] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b52f116e-6797-4985-8ed4-eae3640056df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.380614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b52f116e-6797-4985-8ed4-eae3640056df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.380741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b52f116e-6797-4985-8ed4-eae3640056df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.380879] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b52f116e-6797-4985-8ed4-eae3640056df',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.881309] env[65678]: INFO networking_nsxv3.common.synchronization [None req-730beecd-1811-48d4-b495-6de12239837e None None] Enqueued Resource ID: 14d2ccab-240a-45d9-b510-dea3b64fbd69 with Priority: HIGHEST for action port [ 593.881309] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d2ccab-240a-45d9-b510-dea3b64fbd69 with Priority: HIGHEST for action port [ 593.881309] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-14d2ccab-240a-45d9-b510-dea3b64fbd69 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.881309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14d2ccab-240a-45d9-b510-dea3b64fbd69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.881309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14d2ccab-240a-45d9-b510-dea3b64fbd69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.881309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14d2ccab-240a-45d9-b510-dea3b64fbd69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.881309] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14d2ccab-240a-45d9-b510-dea3b64fbd69',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.886746] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b52f116e-6797-4985-8ed4-eae3640056df [ 593.886746] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.886746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.886746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.886746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.886746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.886746] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b52f116e-6797-4985-8ed4-eae3640056df already deleted. [ 593.886746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b52f116e-6797-4985-8ed4-eae3640056df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.385860] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14d2ccab-240a-45d9-b510-dea3b64fbd69 [ 594.386141] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.386294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.386334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.386520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.386608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.386699] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14d2ccab-240a-45d9-b510-dea3b64fbd69 already deleted. [ 594.386812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14d2ccab-240a-45d9-b510-dea3b64fbd69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.433394] env[65678]: INFO networking_nsxv3.common.synchronization [None req-ab47f2a4-4f20-4607-9b2e-7fbc08a8926f tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 594.434528] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 594.434528] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.434528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.434528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.434736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.434736] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.760092] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e2335f3c-9d55-4ef3-b2fe-f44c247fd02f None None] Enqueued Resource ID: 01aff5c4-9d63-48de-8e30-5a7d2a69cf0d with Priority: HIGHEST for action port [ 594.760164] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01aff5c4-9d63-48de-8e30-5a7d2a69cf0d with Priority: HIGHEST for action port [ 594.761104] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-01aff5c4-9d63-48de-8e30-5a7d2a69cf0d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.761104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01aff5c4-9d63-48de-8e30-5a7d2a69cf0d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.761104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01aff5c4-9d63-48de-8e30-5a7d2a69cf0d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.761256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01aff5c4-9d63-48de-8e30-5a7d2a69cf0d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.761297] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01aff5c4-9d63-48de-8e30-5a7d2a69cf0d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.785044] env[65678]: INFO networking_nsxv3.common.synchronization [None req-bf6b1e79-6d19-4385-9011-688cdc5bb0e3 tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 594.785799] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 594.786334] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.788271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.959417] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.959417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.959417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.961471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.961471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.961471] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 already deleted. [ 594.961471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.961471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.961471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.961471] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.265466] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01aff5c4-9d63-48de-8e30-5a7d2a69cf0d [ 595.267126] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.267126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.267126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.267126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.267126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.267126] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01aff5c4-9d63-48de-8e30-5a7d2a69cf0d already deleted. [ 595.267126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01aff5c4-9d63-48de-8e30-5a7d2a69cf0d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.485031] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.485031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.485031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.485031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.485031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.485031] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 already deleted. [ 595.485031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.833456] env[65678]: INFO networking_nsxv3.common.synchronization [None req-87713bd5-daed-4879-b561-b4ef6434e3d6 None None] Enqueued Resource ID: df73bf3e-fc41-4109-b5e8-41bde0f8806a with Priority: HIGHEST for action port [ 595.835251] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df73bf3e-fc41-4109-b5e8-41bde0f8806a with Priority: HIGHEST for action port [ 595.835251] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-df73bf3e-fc41-4109-b5e8-41bde0f8806a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.835251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df73bf3e-fc41-4109-b5e8-41bde0f8806a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.835251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df73bf3e-fc41-4109-b5e8-41bde0f8806a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.835405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df73bf3e-fc41-4109-b5e8-41bde0f8806a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.835405] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df73bf3e-fc41-4109-b5e8-41bde0f8806a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.336952] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df73bf3e-fc41-4109-b5e8-41bde0f8806a [ 596.337732] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.338023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.338085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.338818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.338818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.338818] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df73bf3e-fc41-4109-b5e8-41bde0f8806a already deleted. [ 596.338818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df73bf3e-fc41-4109-b5e8-41bde0f8806a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.779877] env[65678]: INFO networking_nsxv3.common.synchronization [None req-90402188-e765-4412-81e4-8732f7fba6a5 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_rules [ 596.780200] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_rules [ 596.780360] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.780536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.780593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.780813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.780892] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.247814] env[65678]: INFO networking_nsxv3.common.synchronization [None req-3a244a9b-6265-4aac-91b7-284372c83335 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_rules [ 597.248501] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_rules [ 597.250711] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.250834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.303981] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.304232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.304312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.304532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.304624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.304720] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e already deleted. [ 597.304803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.305021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.305133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.305203] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.477566] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e1a14150-33f0-4d1a-9b27-49e613601dfc None None] Enqueued Resource ID: 42d2561d-aed6-4a49-ac7e-afc3736b6b38 with Priority: HIGHEST for action port [ 597.478147] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d2561d-aed6-4a49-ac7e-afc3736b6b38 with Priority: HIGHEST for action port [ 597.478655] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-42d2561d-aed6-4a49-ac7e-afc3736b6b38 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.478655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42d2561d-aed6-4a49-ac7e-afc3736b6b38" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.478851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42d2561d-aed6-4a49-ac7e-afc3736b6b38" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.479282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42d2561d-aed6-4a49-ac7e-afc3736b6b38" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.479282] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42d2561d-aed6-4a49-ac7e-afc3736b6b38',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.828488] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.828488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.828488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.831033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.831033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.831033] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e already deleted. [ 597.831033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.982417] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42d2561d-aed6-4a49-ac7e-afc3736b6b38 [ 597.982730] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.983026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.983026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.983221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.983327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.983407] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42d2561d-aed6-4a49-ac7e-afc3736b6b38 already deleted. [ 597.983486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42d2561d-aed6-4a49-ac7e-afc3736b6b38" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.208913] env[65678]: INFO networking_nsxv3.common.synchronization [None req-8b7bbdb6-12eb-4ade-aa8c-1f167d71251c None None] Enqueued Resource ID: 348712e3-5c45-43ce-a15a-0c650f54e49a with Priority: HIGHEST for action port [ 598.209442] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 348712e3-5c45-43ce-a15a-0c650f54e49a with Priority: HIGHEST for action port [ 598.211375] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-348712e3-5c45-43ce-a15a-0c650f54e49a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.211375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-348712e3-5c45-43ce-a15a-0c650f54e49a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.211375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-348712e3-5c45-43ce-a15a-0c650f54e49a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.211375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-348712e3-5c45-43ce-a15a-0c650f54e49a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.211375] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('348712e3-5c45-43ce-a15a-0c650f54e49a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.397651] env[65678]: INFO networking_nsxv3.common.synchronization [req-3200766e-fa22-4d89-8fe9-60092e967547 req-05d3da4e-7c1e-41bd-b5c8-9b575af824f2 tempest-ServerDiagnosticsTest-1833923613 tempest-ServerDiagnosticsTest-1833923613-project-member] Enqueued Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGHEST for action security_group_members [ 598.398128] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGHEST for action security_group_members [ 598.398482] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9387d345-5efc-43c7-9adb-0d5c075e3136 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.398599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.398669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.398949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.400336] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.400336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.400336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.400336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.400336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.400336] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9387d345-5efc-43c7-9adb-0d5c075e3136',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.713034] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 348712e3-5c45-43ce-a15a-0c650f54e49a [ 598.713034] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.713185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.713676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.713676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.713676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.713676] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:348712e3-5c45-43ce-a15a-0c650f54e49a already deleted. [ 598.714035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-348712e3-5c45-43ce-a15a-0c650f54e49a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.906150] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.906150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.906150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.906150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.906150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.906530] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.906530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.906530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.909032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.909032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.909032] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 already deleted. [ 598.909032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.443814] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.444035] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.444160] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.444483] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.444747] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.444906] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.447034] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.447296] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.447448] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.447749] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.447869] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.447977] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.448124] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.448241] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.448385] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.448439] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.469380] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.471479] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.471479] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.471479] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.471479] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-58671369-9c90-4eb6-a02e-7374ec83b4f1 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.471771] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-58671369-9c90-4eb6-a02e-7374ec83b4f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.471771] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-58671369-9c90-4eb6-a02e-7374ec83b4f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.472536] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-58671369-9c90-4eb6-a02e-7374ec83b4f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.472730] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58671369-9c90-4eb6-a02e-7374ec83b4f1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.767926] env[65678]: INFO networking_nsxv3.common.synchronization [None req-df146845-cf65-42b8-a6d8-788e00ba9f33 None None] Enqueued Resource ID: 35ee0608-4489-4346-8d23-d45303808a1b with Priority: HIGHEST for action port [ 599.767926] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35ee0608-4489-4346-8d23-d45303808a1b with Priority: HIGHEST for action port [ 599.767926] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-35ee0608-4489-4346-8d23-d45303808a1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.767926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35ee0608-4489-4346-8d23-d45303808a1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.767926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35ee0608-4489-4346-8d23-d45303808a1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.767926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35ee0608-4489-4346-8d23-d45303808a1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.767926] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35ee0608-4489-4346-8d23-d45303808a1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.960580] env[65678]: INFO networking_nsxv3.common.synchronization [req-e987de43-4560-45c1-bff3-c582d150cfff req-733cabc6-6961-479b-84b8-630e002dec8b tempest-ServerDiagnosticsNegativeTest-595215092 tempest-ServerDiagnosticsNegativeTest-595215092-project-member] Enqueued Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGHEST for action security_group_members [ 599.961020] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGHEST for action security_group_members [ 599.961364] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.961536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.961750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.961884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.962363] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.962620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.962711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.962926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.963104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.963204] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8c37326-10eb-4f55-9c8c-9fa3df34ae9e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.976153] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.976368] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.976492] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.976752] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.978116] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.978116] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 58671369-9c90-4eb6-a02e-7374ec83b4f1 not found, creating... [ 599.978116] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.978247] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.979260] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.979566] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.979719] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.980161] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.980327] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.980446] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.981553] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.981711] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.981876] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 58671369-9c90-4eb6-a02e-7374ec83b4f1 is going to be created. [ 600.008636] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.008837] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.008922] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.009215] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.009496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.009718] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-58671369-9c90-4eb6-a02e-7374ec83b4f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.270211] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35ee0608-4489-4346-8d23-d45303808a1b [ 600.270444] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.270642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.270721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.270936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.271040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.271137] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35ee0608-4489-4346-8d23-d45303808a1b already deleted. [ 600.271230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35ee0608-4489-4346-8d23-d45303808a1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.465761] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.465924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.465990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.466763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.466763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.466763] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.466763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.466763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.466980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.466980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.467043] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e already deleted. [ 600.467078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.745826] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.746031] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.746183] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.746454] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.746702] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.746855] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.746965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.747190] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.747329] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.747519] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.747617] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.747725] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.747828] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.747931] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.748041] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.748167] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.768696] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.768696] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.768696] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.768696] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.768696] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-643d1990-5103-47e3-9ae4-6c3012debf41 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.769274] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-643d1990-5103-47e3-9ae4-6c3012debf41" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.769274] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-643d1990-5103-47e3-9ae4-6c3012debf41" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.769274] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-643d1990-5103-47e3-9ae4-6c3012debf41" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.769387] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('643d1990-5103-47e3-9ae4-6c3012debf41',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.827531] env[65678]: INFO networking_nsxv3.common.synchronization [req-3200766e-fa22-4d89-8fe9-60092e967547 req-130d8031-8d94-4960-8729-3f0cf8213efc service nova] Enqueued Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGHEST for action security_group_rules [ 600.827713] env[65678]: INFO networking_nsxv3.common.synchronization [req-3200766e-fa22-4d89-8fe9-60092e967547 req-130d8031-8d94-4960-8729-3f0cf8213efc service nova] Enqueued Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGHEST for action security_group_members [ 600.827848] env[65678]: INFO networking_nsxv3.common.synchronization [req-3200766e-fa22-4d89-8fe9-60092e967547 req-130d8031-8d94-4960-8729-3f0cf8213efc service nova] Enqueued Resource ID: 58671369-9c90-4eb6-a02e-7374ec83b4f1 with Priority: HIGHEST for action port [ 600.828077] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGHEST for action security_group_rules [ 600.828206] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGHEST for action security_group_members [ 600.828301] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58671369-9c90-4eb6-a02e-7374ec83b4f1 with Priority: HIGHEST for action port [ 600.828788] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9387d345-5efc-43c7-9adb-0d5c075e3136 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.828910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.828978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.829359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.829359] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9387d345-5efc-43c7-9adb-0d5c075e3136',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.830184] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9387d345-5efc-43c7-9adb-0d5c075e3136 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.830184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.830283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.830392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.830577] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.830625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.830689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.830831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.830914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.830997] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9387d345-5efc-43c7-9adb-0d5c075e3136',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.831976] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-58671369-9c90-4eb6-a02e-7374ec83b4f1 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.832320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58671369-9c90-4eb6-a02e-7374ec83b4f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.832320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58671369-9c90-4eb6-a02e-7374ec83b4f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.832320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58671369-9c90-4eb6-a02e-7374ec83b4f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.832412] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58671369-9c90-4eb6-a02e-7374ec83b4f1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.911135] env[65678]: INFO networking_nsxv3.common.synchronization [None req-5861031f-363f-4afd-8cc2-b6c8996f91ea tempest-VolumesAssistedSnapshotsTest-310453157 tempest-VolumesAssistedSnapshotsTest-310453157-project-member] Enqueued Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_rules [ 600.911645] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_rules [ 600.912090] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850ea458-7bc9-41b1-87fe-f961a64609eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.912090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.912244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.912367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.912445] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.271885] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.272307] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.272307] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.272517] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.272704] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.272874] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 643d1990-5103-47e3-9ae4-6c3012debf41 not found, creating... [ 601.273149] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.273302] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.273417] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.273637] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.273769] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.274052] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.274203] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.274315] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.274514] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.274638] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.274770] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 643d1990-5103-47e3-9ae4-6c3012debf41 is going to be created. [ 601.293988] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.294255] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.294374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.294801] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.295148] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.295288] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-643d1990-5103-47e3-9ae4-6c3012debf41" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.315142] env[65678]: INFO networking_nsxv3.common.synchronization [None req-c3fbbb6e-87e2-42b6-887b-f1abf99c27c0 tempest-VolumesAssistedSnapshotsTest-310453157 tempest-VolumesAssistedSnapshotsTest-310453157-project-member] Enqueued Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_rules [ 601.315248] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_rules [ 601.315543] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850ea458-7bc9-41b1-87fe-f961a64609eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.315639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.334360] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9387d345-5efc-43c7-9adb-0d5c075e3136 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.334514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.339840] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58671369-9c90-4eb6-a02e-7374ec83b4f1 with status ACTIVE [ 601.340101] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.340244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.340332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.340571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.340670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.340866] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.340991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.341082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.341264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.341358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.341568] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.341674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.341753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.341915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.342016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.342112] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58671369-9c90-4eb6-a02e-7374ec83b4f1 is going to be updated. [ 601.343228] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9387d345-5efc-43c7-9adb-0d5c075e3136',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.365611] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.365760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.365846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.366034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.366169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.366329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58671369-9c90-4eb6-a02e-7374ec83b4f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.446362] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.446523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.446592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.446807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.446908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.446983] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850ea458-7bc9-41b1-87fe-f961a64609eb already deleted. [ 601.447080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.447230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.447390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.447470] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.846019] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9387d345-5efc-43c7-9adb-0d5c075e3136',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.969996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.969996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.969996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.969996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.969996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.969996] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850ea458-7bc9-41b1-87fe-f961a64609eb already deleted. [ 601.969996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.053490] env[65678]: INFO networking_nsxv3.common.synchronization [req-e987de43-4560-45c1-bff3-c582d150cfff req-a7b0882c-3b32-49d8-8891-19ee4a863e78 service nova] Enqueued Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGHEST for action security_group_rules [ 602.053490] env[65678]: INFO networking_nsxv3.common.synchronization [req-e987de43-4560-45c1-bff3-c582d150cfff req-a7b0882c-3b32-49d8-8891-19ee4a863e78 service nova] Enqueued Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGHEST for action security_group_members [ 602.053490] env[65678]: INFO networking_nsxv3.common.synchronization [req-e987de43-4560-45c1-bff3-c582d150cfff req-a7b0882c-3b32-49d8-8891-19ee4a863e78 service nova] Enqueued Resource ID: 643d1990-5103-47e3-9ae4-6c3012debf41 with Priority: HIGHEST for action port [ 602.053490] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGHEST for action security_group_rules [ 602.053490] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGHEST for action security_group_members [ 602.053490] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 643d1990-5103-47e3-9ae4-6c3012debf41 with Priority: HIGHEST for action port [ 602.053490] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.053490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.053490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.054220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.054421] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8c37326-10eb-4f55-9c8c-9fa3df34ae9e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.055666] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.055970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.056132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.056411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.056724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.056934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.057099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.057347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.057549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.058465] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8c37326-10eb-4f55-9c8c-9fa3df34ae9e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.059059] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-643d1990-5103-47e3-9ae4-6c3012debf41 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.059340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-643d1990-5103-47e3-9ae4-6c3012debf41" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.059852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-643d1990-5103-47e3-9ae4-6c3012debf41" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.059852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-643d1990-5103-47e3-9ae4-6c3012debf41" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.059852] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('643d1990-5103-47e3-9ae4-6c3012debf41',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.351236] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.351236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.351236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.351236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.351236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.351236] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 is going to be created. [ 602.388623] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.388819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.388911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.389137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.389323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.406314] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 in Status: UNINITIALIZED for 2s [ 602.562992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.563151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.563326] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8c37326-10eb-4f55-9c8c-9fa3df34ae9e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.564295] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 643d1990-5103-47e3-9ae4-6c3012debf41 with status ACTIVE [ 602.564490] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.564599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.564658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.564865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.564984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.565184] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.565284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.565346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.565508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.565586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.565765] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.565859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.565957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.566107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.566185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.566268] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 643d1990-5103-47e3-9ae4-6c3012debf41 is going to be updated. [ 602.587950] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.588154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.588154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.588392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.588523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.588676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-643d1990-5103-47e3-9ae4-6c3012debf41" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.068314] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8c37326-10eb-4f55-9c8c-9fa3df34ae9e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.338671] env[65678]: INFO networking_nsxv3.common.synchronization [None req-2d16f626-c2ef-4113-a77a-aa0c4ea17d2f None None] Enqueued Resource ID: 92d2df9c-0fa7-4f50-9da7-185002caf019 with Priority: HIGHEST for action port [ 603.338671] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92d2df9c-0fa7-4f50-9da7-185002caf019 with Priority: HIGHEST for action port [ 603.338841] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-92d2df9c-0fa7-4f50-9da7-185002caf019 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.338975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92d2df9c-0fa7-4f50-9da7-185002caf019" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.339237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92d2df9c-0fa7-4f50-9da7-185002caf019" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.339539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92d2df9c-0fa7-4f50-9da7-185002caf019" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.339652] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92d2df9c-0fa7-4f50-9da7-185002caf019',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.352026] env[65678]: INFO networking_nsxv3.common.synchronization [req-8f69ca06-974e-4181-88ce-c1c7f8c25778 req-f922d535-d952-4f92-8fc9-a04577eedaf6 tempest-DeleteServersAdminTestJSON-1802841318 tempest-DeleteServersAdminTestJSON-1802841318-project-member] Enqueued Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 603.352488] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 603.352843] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.352977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.353038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.353285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.353441] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.353544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.353607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.353997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.353997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.353997] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.571885] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.572063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.572174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.572441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.572441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.572518] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e is going to be created. [ 603.599493] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.599652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.599692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.600512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.600512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.612673] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e in Status: UNINITIALIZED for 2s [ 603.819990] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.820258] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.820470] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.820877] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.821180] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.821341] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.821457] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.821718] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.821932] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.822160] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.822275] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.822382] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.822485] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.822614] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.822725] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.822857] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.844634] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92d2df9c-0fa7-4f50-9da7-185002caf019 [ 603.844852] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.844985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.845065] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.845275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.845435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.845518] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92d2df9c-0fa7-4f50-9da7-185002caf019 already deleted. [ 603.845598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92d2df9c-0fa7-4f50-9da7-185002caf019" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.846857] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.847023] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.847163] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.847324] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.847603] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.847762] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.847874] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.848229] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.848638] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.857877] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.857877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.857877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.858017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.858200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.858315] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.858380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.858411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.858559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.858631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.858710] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db already deleted. [ 603.858785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.351385] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.351692] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.351821] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.352115] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.352491] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.352491] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c not found, creating... [ 604.352941] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.353064] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.353120] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.357019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.357019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.357019] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.357019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.357019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.357019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.357019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.357019] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c is going to be created. [ 604.380380] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.380580] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.380709] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.380974] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.381202] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.381413] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.422929] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 in Status: SUCCESS [ 604.422929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.422929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.423412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.423412] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.423412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.423412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.423623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.423657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.424062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.424062] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9387d345-5efc-43c7-9adb-0d5c075e3136',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.928194] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9387d345-5efc-43c7-9adb-0d5c075e3136 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.928194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.928194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.928194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.928194] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.928194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.928539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.928539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.928539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.928674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.928716] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9387d345-5efc-43c7-9adb-0d5c075e3136 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.928812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.928967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.929057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.929218] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.929347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.929399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.929845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.929845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.929845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.929845] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9387d345-5efc-43c7-9adb-0d5c075e3136',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.115640] env[65678]: INFO networking_nsxv3.common.synchronization [req-8f69ca06-974e-4181-88ce-c1c7f8c25778 req-a95d8a0c-0c06-418a-999b-85192166f418 service nova] Enqueued Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_rules [ 605.115993] env[65678]: INFO networking_nsxv3.common.synchronization [req-8f69ca06-974e-4181-88ce-c1c7f8c25778 req-a95d8a0c-0c06-418a-999b-85192166f418 service nova] Enqueued Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 605.116190] env[65678]: INFO networking_nsxv3.common.synchronization [req-8f69ca06-974e-4181-88ce-c1c7f8c25778 req-a95d8a0c-0c06-418a-999b-85192166f418 service nova] Enqueued Resource ID: 3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c with Priority: HIGHEST for action port [ 605.116772] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_rules [ 605.116913] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 605.118592] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c with Priority: HIGHEST for action port [ 605.118854] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.118949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.118987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.119989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.119989] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.120880] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.121027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.121074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.121280] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.121513] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.121575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.121575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.121755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.122774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.122774] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.124619] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.124767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.124837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.125084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.125150] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.361752] env[65678]: INFO networking_nsxv3.common.synchronization [req-977fb938-1cf2-42fc-9c5b-3da665a38bf7 req-4d3634eb-8e59-4f92-b25f-a197534f081a tempest-FloatingIPsAssociationTestJSON-1218227649 tempest-FloatingIPsAssociationTestJSON-1218227649-project-member] Enqueued Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 605.363170] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 605.363505] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.364948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.365057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.365328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.365576] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.365649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.365649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.365805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.365883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.365973] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.432386] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9387d345-5efc-43c7-9adb-0d5c075e3136: rpc.has_security_group_logging(os_id): False [ 605.452345] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.452530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.452653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.452865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.452953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.453197] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.453575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.453575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.453575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.453575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.453804] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.453907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.453907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.454089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.454170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.454321] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.454448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.454525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.454606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.454695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.454761] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 is going to be created. [ 605.534699] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.534878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.534971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.535281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.535390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.551656] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 in Status: IN_PROGRESS for 2s [ 605.621652] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.621652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.629047] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e in Status: SUCCESS [ 605.629047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.629705] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c with status ACTIVE [ 605.629918] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.634224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.634320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.634590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.634681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.634925] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.635159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.635209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.635445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.635554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.635862] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.636027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.636133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.636385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.636459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.636572] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c is going to be updated. [ 605.638187] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.638840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.639046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.639242] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.639363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.639425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.639865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.639865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.639865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.640059] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8c37326-10eb-4f55-9c8c-9fa3df34ae9e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.683084] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.683252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.683306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.683532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.683672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.683893] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a2c0dc1-0c62-4c2d-aaf0-c15cc8e0447c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.854864] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.854864] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-593" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.854864] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-593" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.855394] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-593" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.855991] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.856332] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.856546] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.857105] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.857330] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.857628] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.857791] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.857947] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.858145] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.858306] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.858464] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.858667] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.868508] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.868928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.868928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.869415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.869569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.870094] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.870094] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.870257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.870434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.870510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.870661] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9497cc12-615a-4090-934d-a1b00059825f already deleted. [ 605.870754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.886609] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.886791] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.886918] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.887117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-593" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.887489] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-0076755c-d5b3-4d4a-822f-244771f2a9c0 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.887679] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-0076755c-d5b3-4d4a-822f-244771f2a9c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.888557] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-0076755c-d5b3-4d4a-822f-244771f2a9c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.889061] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-0076755c-d5b3-4d4a-822f-244771f2a9c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.889253] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0076755c-d5b3-4d4a-822f-244771f2a9c0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.142583] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.143547] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.144088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.144088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.144234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.144413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.144932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.144932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.144932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.144932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.144932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.145236] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.145236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.145236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.145396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.145560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.145664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.145755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.145942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.146042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.146149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.146237] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8c37326-10eb-4f55-9c8c-9fa3df34ae9e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.377923] env[65678]: INFO networking_nsxv3.common.synchronization [None req-89d52120-2993-487f-9ba2-dc99d07ebb25 None None] Enqueued Resource ID: bbfb8997-440b-455e-b8f8-4716c2929ed9 with Priority: HIGHEST for action port [ 606.379471] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbfb8997-440b-455e-b8f8-4716c2929ed9 with Priority: HIGHEST for action port [ 606.379809] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbfb8997-440b-455e-b8f8-4716c2929ed9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.379945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbfb8997-440b-455e-b8f8-4716c2929ed9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.380033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbfb8997-440b-455e-b8f8-4716c2929ed9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.380354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbfb8997-440b-455e-b8f8-4716c2929ed9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.380354] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbfb8997-440b-455e-b8f8-4716c2929ed9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.393446] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.393675] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.393816] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.394133] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.394292] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.394441] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 0076755c-d5b3-4d4a-822f-244771f2a9c0 not found, creating... [ 606.394718] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.394917] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.395014] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.395245] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.395964] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.395964] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.395964] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.395964] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.396189] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.396258] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.396376] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 0076755c-d5b3-4d4a-822f-244771f2a9c0 is going to be created. [ 606.419051] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.419523] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.419523] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.419703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.419951] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.420190] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-0076755c-d5b3-4d4a-822f-244771f2a9c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.648529] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.648720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.648775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.648969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.649068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.649168] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db is going to be created. [ 606.650362] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8c37326-10eb-4f55-9c8c-9fa3df34ae9e: rpc.has_security_group_logging(os_id): False [ 606.680825] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.681027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.681088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.681286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.681435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.689478] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.690724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.690724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.690724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.690724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.690724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.690724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.690724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.690724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.690724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.691319] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.691319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.691319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.691319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.691319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.691474] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.691621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.691621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.691782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.691853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.691946] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e is going to be created. [ 606.697918] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: UNINITIALIZED for 2s [ 606.769073] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.769073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.769073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.769073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.769073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.782750] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e in Status: IN_PROGRESS for 2s [ 606.883421] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbfb8997-440b-455e-b8f8-4716c2929ed9 [ 606.883750] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.884576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.884576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.890710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.890710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.890710] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbfb8997-440b-455e-b8f8-4716c2929ed9 already deleted. [ 606.890710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbfb8997-440b-455e-b8f8-4716c2929ed9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.170079] env[65678]: INFO networking_nsxv3.common.synchronization [req-977fb938-1cf2-42fc-9c5b-3da665a38bf7 req-bdaea964-e93a-4933-b483-8b673a21a7cb service nova] Enqueued Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_rules [ 607.170079] env[65678]: INFO networking_nsxv3.common.synchronization [req-977fb938-1cf2-42fc-9c5b-3da665a38bf7 req-bdaea964-e93a-4933-b483-8b673a21a7cb service nova] Enqueued Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 607.170079] env[65678]: INFO networking_nsxv3.common.synchronization [req-977fb938-1cf2-42fc-9c5b-3da665a38bf7 req-bdaea964-e93a-4933-b483-8b673a21a7cb service nova] Enqueued Resource ID: 0076755c-d5b3-4d4a-822f-244771f2a9c0 with Priority: HIGHEST for action port [ 607.170478] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_rules [ 607.170478] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 607.170654] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0076755c-d5b3-4d4a-822f-244771f2a9c0 with Priority: HIGHEST for action port [ 607.171019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.171019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.171019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.171835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.171835] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.172668] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.172668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.172668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.172945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.172945] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.173063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.173161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.173298] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.173404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.173502] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.175242] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-0076755c-d5b3-4d4a-822f-244771f2a9c0 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.175242] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0076755c-d5b3-4d4a-822f-244771f2a9c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.175242] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0076755c-d5b3-4d4a-822f-244771f2a9c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.175526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0076755c-d5b3-4d4a-822f-244771f2a9c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.175526] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0076755c-d5b3-4d4a-822f-244771f2a9c0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.565679] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 in Status: SUCCESS [ 607.565994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.642564] env[65678]: INFO networking_nsxv3.common.synchronization [req-aeee7236-fe43-4fdc-aa9d-7fd02e937dff req-0948818f-cfe3-4505-8263-1baebf109bef tempest-ServerMetadataNegativeTestJSON-1716865601 tempest-ServerMetadataNegativeTestJSON-1716865601-project-member] Enqueued Resource ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 with Priority: HIGHEST for action security_group_members [ 607.642564] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 with Priority: HIGHEST for action security_group_members [ 607.642564] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda39a55-69e8-4fac-bca6-eac8c60627f3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.642564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.643049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.643049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.644545] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.644650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.645069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.645069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.645069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.645069] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cda39a55-69e8-4fac-bca6-eac8c60627f3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.677157] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.677341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.677553] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.678406] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0076755c-d5b3-4d4a-822f-244771f2a9c0 with status ACTIVE [ 607.678727] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.678881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.678929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.679147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.679247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.679414] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.679536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.679606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.679760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.679794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.679948] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.680104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.680226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.680334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.680424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.681130] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0076755c-d5b3-4d4a-822f-244771f2a9c0 is going to be updated. [ 607.702583] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.702946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.702946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.703055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.703203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.703357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0076755c-d5b3-4d4a-822f-244771f2a9c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.044617] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-78 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.044828] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-78" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.044924] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-78" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.045338] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-78" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.045601] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.045750] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.045860] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.046265] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.046426] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.046628] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.046737] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.046839] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.046939] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.047055] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.047162] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.047277] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.057482] env[65678]: INFO networking_nsxv3.common.synchronization [None req-925cf573-d74f-4d61-9629-9907d441fea4 None None] Enqueued Resource ID: 744e47ab-d84e-46ad-9338-943186abd03f with Priority: HIGHEST for action port [ 608.057958] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744e47ab-d84e-46ad-9338-943186abd03f with Priority: HIGHEST for action port [ 608.058268] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-744e47ab-d84e-46ad-9338-943186abd03f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.058388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-744e47ab-d84e-46ad-9338-943186abd03f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.058459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-744e47ab-d84e-46ad-9338-943186abd03f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.058693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-744e47ab-d84e-46ad-9338-943186abd03f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.058776] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('744e47ab-d84e-46ad-9338-943186abd03f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.071628] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.071628] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.071628] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.071628] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-78" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.071628] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-d69f31df-9a78-472b-9293-a2ac490bf77d taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.071628] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-d69f31df-9a78-472b-9293-a2ac490bf77d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.071628] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-d69f31df-9a78-472b-9293-a2ac490bf77d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.071628] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-d69f31df-9a78-472b-9293-a2ac490bf77d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.071628] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d69f31df-9a78-472b-9293-a2ac490bf77d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.147059] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.147265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.147337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.147543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.148163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.148163] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.148163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.148163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.148477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.148477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.148477] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 already deleted. [ 608.148640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.182414] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.563056] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 744e47ab-d84e-46ad-9338-943186abd03f [ 608.563056] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.563056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.563056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.563056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.563056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.563056] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:744e47ab-d84e-46ad-9338-943186abd03f already deleted. [ 608.563056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-744e47ab-d84e-46ad-9338-943186abd03f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.574894] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.575357] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.575530] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.575860] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.576017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.576180] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port d69f31df-9a78-472b-9293-a2ac490bf77d not found, creating... [ 608.576453] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.576637] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.576749] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.576991] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.578949] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.579311] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.579505] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.579661] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.580135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.580135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.580135] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: d69f31df-9a78-472b-9293-a2ac490bf77d is going to be created. [ 608.606176] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.606430] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.606549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.606825] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.607078] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.607404] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-d69f31df-9a78-472b-9293-a2ac490bf77d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.685168] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.685343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.685415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.685609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.685698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.685795] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9497cc12-615a-4090-934d-a1b00059825f is going to be created. [ 608.710454] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: SUCCESS [ 608.710675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.710853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.711097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.711296] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.711407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.711480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.711641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.711720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.711791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.711885] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.729938] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.729938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.729938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.730085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.730238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.741211] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: UNINITIALIZED for 2s [ 608.800916] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e in Status: SUCCESS [ 608.801181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.216309] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.216309] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.216309] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.216309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.216813] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.216813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.216813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.216813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.216926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.217821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.217821] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.341704] env[65678]: INFO networking_nsxv3.common.synchronization [req-aeee7236-fe43-4fdc-aa9d-7fd02e937dff req-da32578f-aa8f-4147-a5a2-637d99384eec service nova] Enqueued Resource ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 with Priority: HIGHEST for action security_group_rules [ 609.341990] env[65678]: INFO networking_nsxv3.common.synchronization [req-aeee7236-fe43-4fdc-aa9d-7fd02e937dff req-da32578f-aa8f-4147-a5a2-637d99384eec service nova] Enqueued Resource ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 with Priority: HIGHEST for action security_group_members [ 609.342080] env[65678]: INFO networking_nsxv3.common.synchronization [req-aeee7236-fe43-4fdc-aa9d-7fd02e937dff req-da32578f-aa8f-4147-a5a2-637d99384eec service nova] Enqueued Resource ID: d69f31df-9a78-472b-9293-a2ac490bf77d with Priority: HIGHEST for action port [ 609.342739] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 with Priority: HIGHEST for action security_group_rules [ 609.342883] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 with Priority: HIGHEST for action security_group_members [ 609.344514] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d69f31df-9a78-472b-9293-a2ac490bf77d with Priority: HIGHEST for action port [ 609.345534] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cda39a55-69e8-4fac-bca6-eac8c60627f3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.345534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.345534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.345801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.345801] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cda39a55-69e8-4fac-bca6-eac8c60627f3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.348078] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda39a55-69e8-4fac-bca6-eac8c60627f3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.349292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.349292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.349292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.349292] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.351118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.351215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.351416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.351513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.351624] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cda39a55-69e8-4fac-bca6-eac8c60627f3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.352998] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d69f31df-9a78-472b-9293-a2ac490bf77d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.353169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d69f31df-9a78-472b-9293-a2ac490bf77d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.353205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d69f31df-9a78-472b-9293-a2ac490bf77d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.353392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d69f31df-9a78-472b-9293-a2ac490bf77d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.353466] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d69f31df-9a78-472b-9293-a2ac490bf77d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.720977] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a4a38bf-eedc-4528-b75b-a6d281d9d8db: rpc.has_security_group_logging(os_id): False [ 609.742403] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.742642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.743164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.743164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.743296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.743624] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.743787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.743901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.745350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.745350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.745350] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.745350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.745350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.746067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.746067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.746067] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.746067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.746302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.746492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.746868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.747060] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db is going to be created. [ 609.817792] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.817792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.817792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.817792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.817792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.828479] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: IN_PROGRESS for 2s [ 609.849130] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda39a55-69e8-4fac-bca6-eac8c60627f3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.849274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.859113] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cda39a55-69e8-4fac-bca6-eac8c60627f3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.860519] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d69f31df-9a78-472b-9293-a2ac490bf77d with status ACTIVE [ 609.860519] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.860519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.860519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.860867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.860867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.860979] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.861033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.861088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.861271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.861367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.861469] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.861561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.861887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.861887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.861887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.861887] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d69f31df-9a78-472b-9293-a2ac490bf77d is going to be updated. [ 609.884940] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.884940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.884940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.884940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.884940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.884940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d69f31df-9a78-472b-9293-a2ac490bf77d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.075988] env[65678]: INFO networking_nsxv3.common.synchronization [req-f09a8a03-184f-4718-abfc-d05dad43d854 req-94b5816f-1cb1-4510-9ed1-67de336d7213 tempest-MigrationsAdminTest-513313397 tempest-MigrationsAdminTest-513313397-project-member] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 610.076872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 610.077050] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.077200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.077264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.077528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.077691] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.077792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.077846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.078009] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.078099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.078189] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.109126] env[65678]: INFO networking_nsxv3.common.synchronization [None req-f3a1b966-1530-4465-9493-a3ed959c85f4 None None] Enqueued Resource ID: 4f05df50-f022-4d7d-bae2-88c07b96e949 with Priority: HIGHEST for action port [ 610.109696] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f05df50-f022-4d7d-bae2-88c07b96e949 with Priority: HIGHEST for action port [ 610.110402] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f05df50-f022-4d7d-bae2-88c07b96e949 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.110402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f05df50-f022-4d7d-bae2-88c07b96e949" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.110402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f05df50-f022-4d7d-bae2-88c07b96e949" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.110650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f05df50-f022-4d7d-bae2-88c07b96e949" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.110732] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f05df50-f022-4d7d-bae2-88c07b96e949',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.364416] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cda39a55-69e8-4fac-bca6-eac8c60627f3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.581570] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.581860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.581860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.582050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.582153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.582567] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.582706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.582766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.582942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.583034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.583125] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b already deleted. [ 610.583237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.612677] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f05df50-f022-4d7d-bae2-88c07b96e949 [ 610.612891] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.613078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.613136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.613557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.614258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.614258] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f05df50-f022-4d7d-bae2-88c07b96e949 already deleted. [ 610.614258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f05df50-f022-4d7d-bae2-88c07b96e949" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.649320] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.649320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.649320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.649320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.649320] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.649320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.649320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.649868] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.650126] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.650607] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.650823] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.651024] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.651277] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.651492] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.651706] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.652021] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.672163] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.672365] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.672465] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.672681] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.673562] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-34659e3a-02fa-4461-b47d-979353a0f5a9 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.673562] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-34659e3a-02fa-4461-b47d-979353a0f5a9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.673562] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-34659e3a-02fa-4461-b47d-979353a0f5a9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.673866] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-34659e3a-02fa-4461-b47d-979353a0f5a9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.673972] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34659e3a-02fa-4461-b47d-979353a0f5a9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.752163] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: SUCCESS [ 610.752163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.752163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.752511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.752577] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.752715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.752793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.752952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.753048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.753136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.753222] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.868896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.869068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.869225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.869495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.869594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.869702] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 is going to be created. [ 610.900085] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.900330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.900330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.900550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.900801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.915211] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 in Status: UNINITIALIZED for 2s [ 611.109766] env[65678]: INFO networking_nsxv3.common.synchronization [None req-8e777fd9-989b-4169-b9b8-a1acfb54c73f tempest-ServersTestJSON-1589036422 tempest-ServersTestJSON-1589036422-project-member] Enqueued Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_rules [ 611.110912] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_rules [ 611.111421] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40537b9d-ed59-4875-a8af-108e1322d055 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.111713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.111836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.112159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.112341] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.181592] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.182467] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.182467] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.182467] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.182467] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.182805] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 34659e3a-02fa-4461-b47d-979353a0f5a9 not found, creating... [ 611.182882] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.185153] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.185333] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.185655] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.186151] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.186564] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.186805] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.188051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.188051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.188051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.188051] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 34659e3a-02fa-4461-b47d-979353a0f5a9 is going to be created. [ 611.213703] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.213703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.213703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.213703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.213703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.213703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-34659e3a-02fa-4461-b47d-979353a0f5a9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.255751] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.256767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.256767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.256767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.256767] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.257184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.257184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.257380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.257475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.257849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.257849] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.257849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.258134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.258134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.258227] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.258320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.258392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.258554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.259405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.259405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.259405] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.636426] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.636613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.636676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.636916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.637090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.637245] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40537b9d-ed59-4875-a8af-108e1322d055 already deleted. [ 611.637384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.761191] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9497cc12-615a-4090-934d-a1b00059825f: rpc.has_security_group_logging(os_id): False [ 611.781137] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.781586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.781708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.781976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.782543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.782810] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.782954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.783053] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.783249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.783538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.783899] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.784050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.784112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.784277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.784357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.784539] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.784636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.784695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.784838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.784911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.784994] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9497cc12-615a-4090-934d-a1b00059825f is going to be created. [ 611.839974] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: SUCCESS [ 611.840485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.849639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.849799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.849852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.850073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.850247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.860816] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: IN_PROGRESS for 2s [ 611.912541] env[65678]: INFO networking_nsxv3.common.synchronization [req-f09a8a03-184f-4718-abfc-d05dad43d854 req-578ba11e-3ac2-4898-929e-a83839f9fcc5 service nova] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_rules [ 611.913227] env[65678]: INFO networking_nsxv3.common.synchronization [req-f09a8a03-184f-4718-abfc-d05dad43d854 req-578ba11e-3ac2-4898-929e-a83839f9fcc5 service nova] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 611.913227] env[65678]: INFO networking_nsxv3.common.synchronization [req-f09a8a03-184f-4718-abfc-d05dad43d854 req-578ba11e-3ac2-4898-929e-a83839f9fcc5 service nova] Enqueued Resource ID: 34659e3a-02fa-4461-b47d-979353a0f5a9 with Priority: HIGHEST for action port [ 611.913961] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_rules [ 611.913961] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 611.913961] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34659e3a-02fa-4461-b47d-979353a0f5a9 with Priority: HIGHEST for action port [ 611.914341] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.914455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.914567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.914846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.915016] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.916564] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.916564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.916564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.917319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.917319] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.917319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.917319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.917521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.917521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.917627] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.919648] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-34659e3a-02fa-4461-b47d-979353a0f5a9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.919648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34659e3a-02fa-4461-b47d-979353a0f5a9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.919648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34659e3a-02fa-4461-b47d-979353a0f5a9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.919648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34659e3a-02fa-4461-b47d-979353a0f5a9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.919648] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34659e3a-02fa-4461-b47d-979353a0f5a9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.101234] env[65678]: INFO networking_nsxv3.common.synchronization [None req-ba20e52e-1b9a-4cf6-90c2-1f43cbbe6239 tempest-ServersTestJSON-1589036422 tempest-ServersTestJSON-1589036422-project-member] Enqueued Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_rules [ 612.102227] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_rules [ 612.102227] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40537b9d-ed59-4875-a8af-108e1322d055 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.102227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.102344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.102609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.102695] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.421560] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.425028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.425028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.425028] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34659e3a-02fa-4461-b47d-979353a0f5a9 with status ACTIVE [ 612.425028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.425028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.425028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.425028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.425028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.425028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.425028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.425028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.425647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.425843] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.426134] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.426345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.426497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.426747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.426908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.427077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34659e3a-02fa-4461-b47d-979353a0f5a9 is going to be updated. [ 612.455653] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.456182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.457017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.457379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.457651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.457937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34659e3a-02fa-4461-b47d-979353a0f5a9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.628765] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.628765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.628765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.628765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.628765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.628765] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40537b9d-ed59-4875-a8af-108e1322d055 already deleted. [ 612.628765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.927049] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 in Status: SUCCESS [ 612.927389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.927453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.928129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.928129] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.928129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.928486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.928486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.928486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.928486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.928775] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cda39a55-69e8-4fac-bca6-eac8c60627f3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.929490] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.432296] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda39a55-69e8-4fac-bca6-eac8c60627f3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.432296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.432296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.432296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.432296] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.432296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.432296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.432688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.432688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.432688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.432786] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda39a55-69e8-4fac-bca6-eac8c60627f3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.432831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.432896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.433058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.433205] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.433299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.433402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.433497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.433571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.433654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.433772] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cda39a55-69e8-4fac-bca6-eac8c60627f3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.438196] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.438196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.438196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.438338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.438338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.438402] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b is going to be created. [ 613.466038] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.466221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.466221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.466430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.466735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.477289] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: UNINITIALIZED for 2s [ 613.873644] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: SUCCESS [ 613.873923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.940533] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cda39a55-69e8-4fac-bca6-eac8c60627f3: rpc.has_security_group_logging(os_id): False [ 613.959650] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.959650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.959650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.959911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.959911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.960148] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.960247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.960247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.960500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.960548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.960701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.960791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.960853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.960992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.961095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.961286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.961381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.961435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.961916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.963461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.963632] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 is going to be created. [ 614.002977] env[65678]: INFO networking_nsxv3.common.synchronization [req-673adbb9-2db4-43dd-8bfe-349952bf3f82 req-01cf6f66-0a45-46bd-9fe0-0a7595b19366 tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 614.002977] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 614.002977] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.002977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.002977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.002977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.002977] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.002977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.002977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.002977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.002977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.002977] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.023637] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.023637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.023637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.023637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.023637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.037400] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 in Status: IN_PROGRESS for 2s [ 614.417467] env[65678]: INFO networking_nsxv3.common.synchronization [None req-147adc44-a7c3-4d96-acca-8f030aaad879 None None] Enqueued Resource ID: 3251c945-ee41-428c-8f29-4a8057df35db with Priority: HIGHEST for action port [ 614.417467] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3251c945-ee41-428c-8f29-4a8057df35db with Priority: HIGHEST for action port [ 614.417467] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3251c945-ee41-428c-8f29-4a8057df35db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.417467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3251c945-ee41-428c-8f29-4a8057df35db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.417467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3251c945-ee41-428c-8f29-4a8057df35db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.417467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3251c945-ee41-428c-8f29-4a8057df35db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.417467] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3251c945-ee41-428c-8f29-4a8057df35db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.504657] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.504855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.504908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.505210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.505384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.505520] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.505647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.505705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.505877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.505969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.506082] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 already deleted. [ 614.506156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.751988] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.751988] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.751988] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.751988] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.752699] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.752699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.752699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.752699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.752878] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.753036] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.753143] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.753252] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.753352] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.753526] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.753668] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.753843] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.776090] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.776327] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.776482] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.776707] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.777102] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-3eee0150-7cb3-4790-8ed4-b759b257a326 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.777309] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-3eee0150-7cb3-4790-8ed4-b759b257a326" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.777449] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-3eee0150-7cb3-4790-8ed4-b759b257a326" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.777833] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-3eee0150-7cb3-4790-8ed4-b759b257a326" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.778015] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eee0150-7cb3-4790-8ed4-b759b257a326',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.919866] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3251c945-ee41-428c-8f29-4a8057df35db [ 614.919866] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.919866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.919866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.919866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.919866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.920143] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3251c945-ee41-428c-8f29-4a8057df35db already deleted. [ 614.920143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3251c945-ee41-428c-8f29-4a8057df35db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.281462] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.281816] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.281857] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.282175] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.282375] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.282740] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 3eee0150-7cb3-4790-8ed4-b759b257a326 not found, creating... [ 615.283146] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.283146] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.283146] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.283357] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.283737] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.283805] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.284256] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.284256] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.284368] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.285024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.285024] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 3eee0150-7cb3-4790-8ed4-b759b257a326 is going to be created. [ 615.326725] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.327010] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.327142] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.327444] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.327739] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.328053] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-3eee0150-7cb3-4790-8ed4-b759b257a326" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.488195] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: SUCCESS [ 615.488538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.488731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.489043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.489329] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.489611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.489687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.489898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.490317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.490317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.490317] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.992168] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.992336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.992410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.992735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.993138] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.993242] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.993322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.993473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.993551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.993645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.993805] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.993881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.993939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.994093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.994226] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.994312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.994369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.994500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.994568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.994641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.994724] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.052222] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 in Status: SUCCESS [ 616.052484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.072359] env[65678]: INFO networking_nsxv3.common.synchronization [req-673adbb9-2db4-43dd-8bfe-349952bf3f82 req-8d1a3fc8-0ae3-410d-8068-dd99d53eacbd service nova] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 616.072359] env[65678]: INFO networking_nsxv3.common.synchronization [req-673adbb9-2db4-43dd-8bfe-349952bf3f82 req-8d1a3fc8-0ae3-410d-8068-dd99d53eacbd service nova] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 616.072502] env[65678]: INFO networking_nsxv3.common.synchronization [req-673adbb9-2db4-43dd-8bfe-349952bf3f82 req-8d1a3fc8-0ae3-410d-8068-dd99d53eacbd service nova] Enqueued Resource ID: 3eee0150-7cb3-4790-8ed4-b759b257a326 with Priority: HIGHEST for action port [ 616.073092] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 616.073257] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 616.073373] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee0150-7cb3-4790-8ed4-b759b257a326 with Priority: HIGHEST for action port [ 616.074092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.074092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.074092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.074326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.074366] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.075226] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.075578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.075578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.075826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.076154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.076154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.076154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.076380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.076380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.076494] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.077665] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eee0150-7cb3-4790-8ed4-b759b257a326 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.077665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eee0150-7cb3-4790-8ed4-b759b257a326" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.077665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eee0150-7cb3-4790-8ed4-b759b257a326" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.077665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eee0150-7cb3-4790-8ed4-b759b257a326" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.077665] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eee0150-7cb3-4790-8ed4-b759b257a326',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.081803] env[65678]: INFO networking_nsxv3.common.synchronization [None req-6fc9c025-b355-44d9-a5fb-4c9acc8b6fc7 tempest-ServersWithSpecificFlavorTestJSON-1798572525 tempest-ServersWithSpecificFlavorTestJSON-1798572525-project-member] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_rules [ 616.081803] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_rules [ 616.081803] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.082735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.082735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.082735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.082735] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.302913] env[65678]: INFO networking_nsxv3.common.synchronization [None req-da8f409a-2fcf-4c51-a7a2-92f99f71ff93 None None] Enqueued Resource ID: f246146f-bde3-4335-9685-7ae2b444002c with Priority: HIGHEST for action port [ 616.303926] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f246146f-bde3-4335-9685-7ae2b444002c with Priority: HIGHEST for action port [ 616.304174] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-f246146f-bde3-4335-9685-7ae2b444002c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.304310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f246146f-bde3-4335-9685-7ae2b444002c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.304385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f246146f-bde3-4335-9685-7ae2b444002c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.304676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f246146f-bde3-4335-9685-7ae2b444002c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.304792] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f246146f-bde3-4335-9685-7ae2b444002c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.373363] env[65678]: INFO networking_nsxv3.common.synchronization [None req-b35c7c26-b28e-4541-9271-dcfba0bb275f tempest-ServersWithSpecificFlavorTestJSON-1798572525 tempest-ServersWithSpecificFlavorTestJSON-1798572525-project-member] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_rules [ 616.374126] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_rules [ 616.374638] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.375159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.498229] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb02d1eb-8ee4-47ad-b890-95d76e24df1b: rpc.has_security_group_logging(os_id): False [ 616.520563] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.520809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.520883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.521190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.521351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.521534] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.521591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.521656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.521823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.521900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.522115] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.522214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.522258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.522405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.522479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.522704] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.522839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.522917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.523648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.523648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.523648] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b is going to be created. [ 616.583028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.583028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.583028] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.583028] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3eee0150-7cb3-4790-8ed4-b759b257a326 with status ACTIVE [ 616.583028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.583028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.583028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.583028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.583028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.583878] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.583878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.583878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.584161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.584222] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.584903] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.584903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.584903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.584903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.584903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.584903] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3eee0150-7cb3-4790-8ed4-b759b257a326 is going to be updated. [ 616.599203] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.600057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.600057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.600183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.601215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.618910] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.619117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.619728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.619728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.619728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.619728] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433d6ddb-7487-401b-862b-e16865015657 already deleted. [ 616.619911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.620059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.620456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.620456] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.623644] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: IN_PROGRESS for 2s [ 616.629403] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.629403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.629403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.629553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.629728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.630676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eee0150-7cb3-4790-8ed4-b759b257a326" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.807508] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f246146f-bde3-4335-9685-7ae2b444002c [ 616.807763] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.807935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.808022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.810713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.810713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.810713] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f246146f-bde3-4335-9685-7ae2b444002c already deleted. [ 616.810713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f246146f-bde3-4335-9685-7ae2b444002c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.087430] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.144229] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.144409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.144409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.144686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.145373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.145373] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433d6ddb-7487-401b-862b-e16865015657 already deleted. [ 617.145548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.590829] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.590829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.590829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.590829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.590829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.590829] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be created. [ 617.624781] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.624781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.624781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.624781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.624781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.640348] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: UNINITIALIZED for 2s [ 618.165664] env[65678]: INFO networking_nsxv3.common.synchronization [None req-a0feb582-c02a-4343-8fc3-0b3d5c6e9a7e tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_rules [ 618.166123] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_rules [ 618.166553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.166553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.166688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.168125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.168125] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.363570] env[65678]: INFO networking_nsxv3.common.synchronization [None req-a8d23b70-c92b-4f59-ba82-71e9907823ed tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_rules [ 618.364796] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_rules [ 618.365521] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.365879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.368660] env[65678]: INFO networking_nsxv3.common.synchronization [None req-baa73671-dd64-4248-af53-14362cdc0ac7 None None] Enqueued Resource ID: 31d1d9fa-43be-4768-b253-57ea33ce4bf5 with Priority: HIGHEST for action port [ 618.369389] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d1d9fa-43be-4768-b253-57ea33ce4bf5 with Priority: HIGHEST for action port [ 618.370089] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-31d1d9fa-43be-4768-b253-57ea33ce4bf5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.370089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31d1d9fa-43be-4768-b253-57ea33ce4bf5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.370089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31d1d9fa-43be-4768-b253-57ea33ce4bf5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.370394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31d1d9fa-43be-4768-b253-57ea33ce4bf5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.370394] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d1d9fa-43be-4768-b253-57ea33ce4bf5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.641253] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: SUCCESS [ 618.641625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.694906] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.695207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.695207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.695393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.695534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.695597] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 already deleted. [ 618.695669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.695940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.696121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.696232] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.874069] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31d1d9fa-43be-4768-b253-57ea33ce4bf5 [ 618.874449] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.874746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.874949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.875396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.875536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.875690] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31d1d9fa-43be-4768-b253-57ea33ce4bf5 already deleted. [ 618.875840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31d1d9fa-43be-4768-b253-57ea33ce4bf5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.220763] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.220905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.220905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.222675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.222675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.222675] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 already deleted. [ 619.222675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.657551] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 619.657905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.658491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.658491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.658491] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.658790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.658790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.658897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.658897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.658974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.659232] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.162364] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.664645] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9844dc2-a792-4762-9b70-e918899f67f5: rpc.has_security_group_logging(os_id): False [ 620.696867] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.697089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.697089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.697451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.697451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.697690] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.697806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.697806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.697989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.698063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.698184] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be created. [ 620.764167] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.764332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.764396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.764702] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.764900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.779184] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 621.099380] env[65678]: INFO networking_nsxv3.common.synchronization [req-0bc2065c-7d0c-43c5-9b69-5ace3de22386 req-ee17c99a-2b5b-42c5-bdf8-0b59c2539f5b tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_members [ 621.102930] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_members [ 621.103480] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433b7d9d-3978-4af8-a278-70a89b5d5f2e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.103667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.103766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.104201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.104457] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.104651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.104761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.105102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.105400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.105400] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.141423] env[65678]: INFO networking_nsxv3.common.synchronization [None req-bee0283d-96aa-4810-85da-878d38bb8178 None None] Enqueued Resource ID: 0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8 with Priority: HIGHEST for action port [ 621.141980] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8 with Priority: HIGHEST for action port [ 621.142875] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.142875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.142875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.142875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.143193] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.498775] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.499027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.499149] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.499603] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.499928] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.500103] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.500218] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.500482] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.500678] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.500922] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.501066] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.501183] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.501308] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.501518] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.501802] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.501802] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.521811] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.522036] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.522114] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.522280] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.522597] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-78c9aca7-597a-4353-b040-a6bfe22aa7dc taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.522884] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-78c9aca7-597a-4353-b040-a6bfe22aa7dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.523013] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-78c9aca7-597a-4353-b040-a6bfe22aa7dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.523234] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-78c9aca7-597a-4353-b040-a6bfe22aa7dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.523366] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78c9aca7-597a-4353-b040-a6bfe22aa7dc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.608471] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.608726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.608726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.609011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.609113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.609323] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.609434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.609484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.609667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.609736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.609818] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e already deleted. [ 621.609907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.646134] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8 [ 621.646134] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.646391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.646391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.646530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.646626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.646716] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8 already deleted. [ 621.647243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f9dcbb4-8d16-4be4-90d0-14ad9c67b0c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.029040] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.029040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.029040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.029040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.029040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.029040] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 78c9aca7-597a-4353-b040-a6bfe22aa7dc not found, creating... [ 622.029040] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.029040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.029040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.029040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.029040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.029804] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.029804] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.029804] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.029804] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.029804] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.029804] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 78c9aca7-597a-4353-b040-a6bfe22aa7dc is going to be created. [ 622.051749] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.052263] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.052490] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.052934] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.053359] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.053750] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-78c9aca7-597a-4353-b040-a6bfe22aa7dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.790484] env[65678]: INFO networking_nsxv3.common.synchronization [req-0bc2065c-7d0c-43c5-9b69-5ace3de22386 req-b81fb9d7-8879-435f-944b-2ea067baa2d2 service nova] Enqueued Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_rules [ 622.790695] env[65678]: INFO networking_nsxv3.common.synchronization [req-0bc2065c-7d0c-43c5-9b69-5ace3de22386 req-b81fb9d7-8879-435f-944b-2ea067baa2d2 service nova] Enqueued Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_members [ 622.790835] env[65678]: INFO networking_nsxv3.common.synchronization [req-0bc2065c-7d0c-43c5-9b69-5ace3de22386 req-b81fb9d7-8879-435f-944b-2ea067baa2d2 service nova] Enqueued Resource ID: 78c9aca7-597a-4353-b040-a6bfe22aa7dc with Priority: HIGHEST for action port [ 622.791369] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_rules [ 622.791369] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_members [ 622.791369] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c9aca7-597a-4353-b040-a6bfe22aa7dc with Priority: HIGHEST for action port [ 622.792491] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 622.792778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.793175] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.793348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.793464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.793775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.793923] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.795120] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433b7d9d-3978-4af8-a278-70a89b5d5f2e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.795256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.795325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.795534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.795743] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.795867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.795959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.798252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.798252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.798252] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.798252] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-78c9aca7-597a-4353-b040-a6bfe22aa7dc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.798252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78c9aca7-597a-4353-b040-a6bfe22aa7dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.798252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78c9aca7-597a-4353-b040-a6bfe22aa7dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.798252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78c9aca7-597a-4353-b040-a6bfe22aa7dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.798252] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78c9aca7-597a-4353-b040-a6bfe22aa7dc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.997767] env[65678]: INFO networking_nsxv3.common.synchronization [None req-f2ba7314-f606-431f-af8b-dee5652abf81 None None] Enqueued Resource ID: 4337d674-deed-495a-b4db-e7a73ad80270 with Priority: HIGHEST for action port [ 622.998033] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4337d674-deed-495a-b4db-e7a73ad80270 with Priority: HIGHEST for action port [ 622.998744] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-4337d674-deed-495a-b4db-e7a73ad80270 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.998895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4337d674-deed-495a-b4db-e7a73ad80270" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.999214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4337d674-deed-495a-b4db-e7a73ad80270" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.999214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4337d674-deed-495a-b4db-e7a73ad80270" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.999283] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4337d674-deed-495a-b4db-e7a73ad80270',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.157036] env[65678]: INFO networking_nsxv3.common.synchronization [req-bac917ea-e800-4244-9591-04b9ae23f894 req-532723ed-9e89-4e19-8652-821b50f81871 tempest-ServerDiagnosticsTest-1833923613 tempest-ServerDiagnosticsTest-1833923613-project-member] Enqueued Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGHEST for action security_group_members [ 623.157036] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGHEST for action security_group_members [ 623.157036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9387d345-5efc-43c7-9adb-0d5c075e3136 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.157036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.157036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.157036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.157036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.157036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.157036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.157036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.157036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.157036] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9387d345-5efc-43c7-9adb-0d5c075e3136',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.300232] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433b7d9d-3978-4af8-a278-70a89b5d5f2e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.300493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.300782] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.301966] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78c9aca7-597a-4353-b040-a6bfe22aa7dc with status ACTIVE [ 623.302604] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.302604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.302604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.302905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.303060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.304641] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.304641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.304641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.304641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.304641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.304915] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.304915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.304915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.305096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.305170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.305253] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78c9aca7-597a-4353-b040-a6bfe22aa7dc is going to be updated. [ 623.330573] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.330573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.330825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.330885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.330975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.331145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78c9aca7-597a-4353-b040-a6bfe22aa7dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.500753] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4337d674-deed-495a-b4db-e7a73ad80270 [ 623.501787] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.501787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.501787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.501787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.501787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.501787] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4337d674-deed-495a-b4db-e7a73ad80270 already deleted. [ 623.501787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4337d674-deed-495a-b4db-e7a73ad80270" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.659975] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.660151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.660236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.660444] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.660539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.660733] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.660832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.660894] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.661056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.661140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.661212] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 is going to be updated. [ 623.720411] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.720639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.720639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.721198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.721198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.734378] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 in Status: IN_PROGRESS for 2s [ 623.807827] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.938872] env[65678]: INFO networking_nsxv3.common.synchronization [req-9eae2a20-910d-4a1a-9832-2ab2d6e94498 req-0306510f-ca50-4573-b3ca-856f8c2902a4 tempest-VolumesAssistedSnapshotsTest-310453157 tempest-VolumesAssistedSnapshotsTest-310453157-project-member] Enqueued Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_members [ 623.939670] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_members [ 623.940331] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-850ea458-7bc9-41b1-87fe-f961a64609eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.940489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.940590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.940952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.941064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.941151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.941244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.941426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.941526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.941623] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.310768] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.310768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.311591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.311591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.311591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.311591] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e is going to be created. [ 624.339333] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.339480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.339554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.339765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.339921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.343567] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.343756] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-154" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.343875] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-154" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.344205] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-154" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.344465] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.344621] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.344734] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.344948] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.345125] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.345329] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.345437] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.345538] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.345656] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.345745] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.345857] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.345982] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.351436] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e in Status: UNINITIALIZED for 2s [ 624.366510] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.366510] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.366626] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.366803] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-154" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.367141] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-7c59fce5-4c40-4178-be60-ea3bd3879075 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.367312] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-7c59fce5-4c40-4178-be60-ea3bd3879075" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.367468] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-7c59fce5-4c40-4178-be60-ea3bd3879075" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.367790] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-7c59fce5-4c40-4178-be60-ea3bd3879075" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.367925] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c59fce5-4c40-4178-be60-ea3bd3879075',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.444708] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.444906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.444977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.445202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.445295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.445488] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.445587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.445650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.445832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.445947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.446053] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850ea458-7bc9-41b1-87fe-f961a64609eb already deleted. [ 624.446164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.870751] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.870956] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.871082] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.871425] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.871575] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.871789] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 7c59fce5-4c40-4178-be60-ea3bd3879075 not found, creating... [ 624.871978] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.872143] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.872263] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.872531] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.872757] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.873019] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.873177] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.873365] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.873592] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.873998] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.873998] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 7c59fce5-4c40-4178-be60-ea3bd3879075 is going to be created. [ 624.895616] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.895843] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.895980] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.896397] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.896662] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.896946] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-7c59fce5-4c40-4178-be60-ea3bd3879075" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.103373] env[65678]: INFO networking_nsxv3.common.synchronization [None req-1b13897a-4a03-415a-8384-bc990e5d59bd None None] Enqueued Resource ID: a9060347-2779-4022-b3d6-a841561ab3f0 with Priority: HIGHEST for action port [ 625.103373] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9060347-2779-4022-b3d6-a841561ab3f0 with Priority: HIGHEST for action port [ 625.103373] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9060347-2779-4022-b3d6-a841561ab3f0 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.103373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9060347-2779-4022-b3d6-a841561ab3f0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.103373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9060347-2779-4022-b3d6-a841561ab3f0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.104376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9060347-2779-4022-b3d6-a841561ab3f0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.104716] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9060347-2779-4022-b3d6-a841561ab3f0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.610338] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9060347-2779-4022-b3d6-a841561ab3f0 [ 625.610702] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.610777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.610831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.611877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.611877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.612261] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9060347-2779-4022-b3d6-a841561ab3f0 already deleted. [ 625.612399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9060347-2779-4022-b3d6-a841561ab3f0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.644556] env[65678]: INFO networking_nsxv3.common.synchronization [req-9eae2a20-910d-4a1a-9832-2ab2d6e94498 req-b576c972-5c82-46f4-8a9c-5c8edf3f61d7 service nova] Enqueued Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_rules [ 625.644710] env[65678]: INFO networking_nsxv3.common.synchronization [req-9eae2a20-910d-4a1a-9832-2ab2d6e94498 req-b576c972-5c82-46f4-8a9c-5c8edf3f61d7 service nova] Enqueued Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_members [ 625.644860] env[65678]: INFO networking_nsxv3.common.synchronization [req-9eae2a20-910d-4a1a-9832-2ab2d6e94498 req-b576c972-5c82-46f4-8a9c-5c8edf3f61d7 service nova] Enqueued Resource ID: 7c59fce5-4c40-4178-be60-ea3bd3879075 with Priority: HIGHEST for action port [ 625.645398] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_rules [ 625.645541] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_members [ 625.646346] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c59fce5-4c40-4178-be60-ea3bd3879075 with Priority: HIGHEST for action port [ 625.646346] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-850ea458-7bc9-41b1-87fe-f961a64609eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.646346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.646346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.646346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.646576] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.647182] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-850ea458-7bc9-41b1-87fe-f961a64609eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.647306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.647361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.647523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.647666] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.647752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.647814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.647950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.648043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.648130] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.648867] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c59fce5-4c40-4178-be60-ea3bd3879075 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.650552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c59fce5-4c40-4178-be60-ea3bd3879075" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.650552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c59fce5-4c40-4178-be60-ea3bd3879075" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.650552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c59fce5-4c40-4178-be60-ea3bd3879075" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.650552] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c59fce5-4c40-4178-be60-ea3bd3879075',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.751116] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 in Status: SUCCESS [ 625.751116] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 deletion is rescheduled due to dependency. [ 625.751116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.141860] env[65678]: INFO networking_nsxv3.common.synchronization [req-7914f42f-925a-4b20-9b53-696ea231110d req-a3156b91-ecf4-4972-b48e-a557c66f18c0 tempest-InstanceActionsNegativeTestJSON-874151880 tempest-InstanceActionsNegativeTestJSON-874151880-project-member] Enqueued Resource ID: 8631425e-c832-4434-9322-1536d9e46bb8 with Priority: HIGHEST for action security_group_members [ 626.142480] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8631425e-c832-4434-9322-1536d9e46bb8 with Priority: HIGHEST for action security_group_members [ 626.142879] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8631425e-c832-4434-9322-1536d9e46bb8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.143075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.143149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.143437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.143582] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.144277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.144444] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.144675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.144824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.145038] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8631425e-c832-4434-9322-1536d9e46bb8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.151344] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-850ea458-7bc9-41b1-87fe-f961a64609eb taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.151462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.151623] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.153453] env[65678]: INFO networking_nsxv3.common.synchronization [None req-89879c34-54be-4b3a-967f-ff05fcf6ac6f None None] Enqueued Resource ID: 58df721e-7b9d-49a2-8674-7c1b1cff546e with Priority: HIGHEST for action port [ 626.153453] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c59fce5-4c40-4178-be60-ea3bd3879075 with status ACTIVE [ 626.153592] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.153816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.153882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.154954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.154954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.156046] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.156365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.156365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.156811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.156957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.157583] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.157583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.157583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.157835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.157908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.158030] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c59fce5-4c40-4178-be60-ea3bd3879075 is going to be updated. [ 626.161094] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58df721e-7b9d-49a2-8674-7c1b1cff546e with Priority: HIGHEST for action port [ 626.162381] env[65678]: INFO networking_nsxv3.common.synchronization [req-620497da-4a29-4c02-948f-137ce00046ea req-44645d80-3bcf-4f98-999c-66ca74085574 tempest-ServerDiagnosticsNegativeTest-595215092 tempest-ServerDiagnosticsNegativeTest-595215092-project-member] Enqueued Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGHEST for action security_group_members [ 626.162814] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-58df721e-7b9d-49a2-8674-7c1b1cff546e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.162994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58df721e-7b9d-49a2-8674-7c1b1cff546e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.163634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58df721e-7b9d-49a2-8674-7c1b1cff546e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.163634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58df721e-7b9d-49a2-8674-7c1b1cff546e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.163634] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58df721e-7b9d-49a2-8674-7c1b1cff546e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.168988] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGHEST for action security_group_members [ 626.168988] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.168988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.168988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.168988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.168988] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.168988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.168988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.168988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.168988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.168988] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8c37326-10eb-4f55-9c8c-9fa3df34ae9e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.189896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.190069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.190140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.190353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.190519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.190925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c59fce5-4c40-4178-be60-ea3bd3879075" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.363143] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e in Status: SUCCESS [ 626.363363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.363902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.364239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.364344] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.365926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.365926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.365926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.365926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.365926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.365926] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.551300] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.551300] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-357" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.551300] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-357" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.551827] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-357" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.552095] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.552290] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.552763] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.552763] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.552930] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.553151] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.553287] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.553375] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.553477] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.553668] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.553755] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.553917] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.575828] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.576041] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.576219] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.576454] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-357" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.576809] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-f839d7a1-7533-44fb-aea5-a2d9d4af391e taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.576998] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-f839d7a1-7533-44fb-aea5-a2d9d4af391e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.580685] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-f839d7a1-7533-44fb-aea5-a2d9d4af391e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.581930] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-f839d7a1-7533-44fb-aea5-a2d9d4af391e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.581930] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f839d7a1-7533-44fb-aea5-a2d9d4af391e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.648479] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.648862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.648862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.648951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.649013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.649215] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.649318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.649409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.649559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.649636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.649723] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8631425e-c832-4434-9322-1536d9e46bb8 already deleted. [ 626.649825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.662197] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.665849] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58df721e-7b9d-49a2-8674-7c1b1cff546e [ 626.665919] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.665996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.666162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.666278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.666365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.666537] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58df721e-7b9d-49a2-8674-7c1b1cff546e already deleted. [ 626.666537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58df721e-7b9d-49a2-8674-7c1b1cff546e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.672262] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.672390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.672460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.672691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.672787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.672971] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.673089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.673153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.673313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.673493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.673588] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e is going to be updated. [ 626.706991] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.707171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.707242] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.707450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.707747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.719625] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e in Status: IN_PROGRESS for 2s [ 626.867662] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.083686] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.083921] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.084075] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.084354] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.084512] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.084662] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port f839d7a1-7533-44fb-aea5-a2d9d4af391e not found, creating... [ 627.084916] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.085093] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.085206] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.085427] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.085823] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.085893] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.086135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.086278] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.086484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.086622] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.086755] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: f839d7a1-7533-44fb-aea5-a2d9d4af391e is going to be created. [ 627.109526] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.109526] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.109526] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.109526] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.109526] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.109526] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-f839d7a1-7533-44fb-aea5-a2d9d4af391e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.164130] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.164307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.164376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.164591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.164699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.164800] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850ea458-7bc9-41b1-87fe-f961a64609eb is going to be created. [ 627.198147] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.198364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.198364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.198560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.198717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.220954] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850ea458-7bc9-41b1-87fe-f961a64609eb in Status: UNINITIALIZED for 2s [ 627.371799] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 433b7d9d-3978-4af8-a278-70a89b5d5f2e: rpc.has_security_group_logging(os_id): False [ 627.397197] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.397387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.397437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.397639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.397722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.397967] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.398152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.398215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.398375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.398458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.398530] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e is going to be created. [ 627.468155] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.468308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.468369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.469138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.469138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.483405] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e in Status: IN_PROGRESS for 2s [ 627.853400] env[65678]: INFO networking_nsxv3.common.synchronization [req-7914f42f-925a-4b20-9b53-696ea231110d req-f7acb145-3c2c-4026-9108-873b95d376a0 service nova] Enqueued Resource ID: 8631425e-c832-4434-9322-1536d9e46bb8 with Priority: HIGHEST for action security_group_rules [ 627.853759] env[65678]: INFO networking_nsxv3.common.synchronization [req-7914f42f-925a-4b20-9b53-696ea231110d req-f7acb145-3c2c-4026-9108-873b95d376a0 service nova] Enqueued Resource ID: 8631425e-c832-4434-9322-1536d9e46bb8 with Priority: HIGHEST for action security_group_members [ 627.853759] env[65678]: INFO networking_nsxv3.common.synchronization [req-7914f42f-925a-4b20-9b53-696ea231110d req-f7acb145-3c2c-4026-9108-873b95d376a0 service nova] Enqueued Resource ID: f839d7a1-7533-44fb-aea5-a2d9d4af391e with Priority: HIGHEST for action port [ 627.854304] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8631425e-c832-4434-9322-1536d9e46bb8 with Priority: HIGHEST for action security_group_rules [ 627.854447] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8631425e-c832-4434-9322-1536d9e46bb8 with Priority: HIGHEST for action security_group_members [ 627.854553] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f839d7a1-7533-44fb-aea5-a2d9d4af391e with Priority: HIGHEST for action port [ 627.856101] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8631425e-c832-4434-9322-1536d9e46bb8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.856415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.856595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.856907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.856979] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8631425e-c832-4434-9322-1536d9e46bb8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.857831] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8631425e-c832-4434-9322-1536d9e46bb8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.857951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.858019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.858373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.858529] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.858637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.858871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.859530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.859647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.860214] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8631425e-c832-4434-9322-1536d9e46bb8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.861310] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-f839d7a1-7533-44fb-aea5-a2d9d4af391e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.861509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f839d7a1-7533-44fb-aea5-a2d9d4af391e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.861509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f839d7a1-7533-44fb-aea5-a2d9d4af391e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.862232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f839d7a1-7533-44fb-aea5-a2d9d4af391e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.862232] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f839d7a1-7533-44fb-aea5-a2d9d4af391e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.333745] env[65678]: INFO networking_nsxv3.common.synchronization [req-ff86f2ed-7200-43a4-a40d-da57da019847 req-c50d8d6b-956f-4b41-b473-b1e225a039e7 tempest-ServersTestJSON-1589036422 tempest-ServersTestJSON-1589036422-project-member] Enqueued Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_members [ 628.333745] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_members [ 628.334369] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-40537b9d-ed59-4875-a8af-108e1322d055 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.334497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.334599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.334838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.335936] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.336122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.336307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.336933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.337115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.337241] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.363661] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8631425e-c832-4434-9322-1536d9e46bb8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.363781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.365500] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8631425e-c832-4434-9322-1536d9e46bb8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.367920] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f839d7a1-7533-44fb-aea5-a2d9d4af391e with status ACTIVE [ 628.368240] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.368447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.368561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.368793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.368949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.369238] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.374849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.374849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.374849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.374849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.374849] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.374849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.374849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.374849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.374849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.374849] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f839d7a1-7533-44fb-aea5-a2d9d4af391e is going to be updated. [ 628.402312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.402312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.403583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.403583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.403583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.403583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f839d7a1-7533-44fb-aea5-a2d9d4af391e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.732482] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e in Status: SUCCESS [ 628.735400] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e deletion is rescheduled due to dependency. [ 628.735400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.782696] env[65678]: INFO networking_nsxv3.common.synchronization [None req-939b2ba4-eb13-44d8-a46c-a225835cd0b1 None None] Enqueued Resource ID: 6dc133e8-9fed-4e5e-966a-8560f44b0002 with Priority: HIGHEST for action port [ 628.784019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc133e8-9fed-4e5e-966a-8560f44b0002 with Priority: HIGHEST for action port [ 628.787179] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dc133e8-9fed-4e5e-966a-8560f44b0002 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.787343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dc133e8-9fed-4e5e-966a-8560f44b0002" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.787413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dc133e8-9fed-4e5e-966a-8560f44b0002" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.787745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dc133e8-9fed-4e5e-966a-8560f44b0002" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.787825] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dc133e8-9fed-4e5e-966a-8560f44b0002',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.826542] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.826804] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-822" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.826898] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-822" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.827818] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-822" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.827818] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.827818] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.828141] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.828245] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.828393] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.828604] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.828711] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.828838] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.828994] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.829091] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.829201] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.829337] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.840897] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.841150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.841150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.841362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.841464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.841849] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.841849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.841849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.842049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.842081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.842155] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40537b9d-ed59-4875-a8af-108e1322d055 already deleted. [ 628.842227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.852502] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.852755] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.852862] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.853144] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-822" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.853411] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-bff61bd7-6f22-4249-92c6-e1d881fe9148 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.853751] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-bff61bd7-6f22-4249-92c6-e1d881fe9148" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.853751] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-bff61bd7-6f22-4249-92c6-e1d881fe9148" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.854076] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-bff61bd7-6f22-4249-92c6-e1d881fe9148" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.854350] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff61bd7-6f22-4249-92c6-e1d881fe9148',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.874602] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8631425e-c832-4434-9322-1536d9e46bb8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.236782] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850ea458-7bc9-41b1-87fe-f961a64609eb in Status: SUCCESS [ 629.236782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.237092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.237138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.237291] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.237400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.237455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.237618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.237700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.237785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.237873] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.290738] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dc133e8-9fed-4e5e-966a-8560f44b0002 [ 629.291179] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.291355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.291487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.291711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.291837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.291944] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dc133e8-9fed-4e5e-966a-8560f44b0002 already deleted. [ 629.292080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dc133e8-9fed-4e5e-966a-8560f44b0002" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.357253] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.357538] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.357717] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.358097] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.358299] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.358505] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port bff61bd7-6f22-4249-92c6-e1d881fe9148 not found, creating... [ 629.358866] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.359091] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.359255] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.359541] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.359725] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.360135] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.360345] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.360522] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.360809] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.360987] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.361195] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: bff61bd7-6f22-4249-92c6-e1d881fe9148 is going to be created. [ 629.376937] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.377094] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.377163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.377369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.377455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.377549] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8631425e-c832-4434-9322-1536d9e46bb8 is going to be created. [ 629.382546] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.382827] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.383033] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.383394] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.383743] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.384071] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-bff61bd7-6f22-4249-92c6-e1d881fe9148" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.411335] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.411496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.411563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.411796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.411958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.422799] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8631425e-c832-4434-9322-1536d9e46bb8 in Status: UNINITIALIZED for 2s [ 629.507083] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e in Status: SUCCESS [ 629.507452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.734751] env[65678]: INFO networking_nsxv3.common.synchronization [req-19250bd7-096c-48f3-814b-9955af3899ce req-e8a0b57c-aabf-4d58-8470-14d911eb2110 tempest-DeleteServersAdminTestJSON-2142783473 tempest-DeleteServersAdminTestJSON-2142783473-project-admin] Enqueued Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 629.734751] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 629.734847] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.734933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.735076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.735243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.735403] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.735553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.735553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.735727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.735788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.735879] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.740584] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.086390] env[65678]: INFO networking_nsxv3.common.synchronization [req-ff86f2ed-7200-43a4-a40d-da57da019847 req-6c6a4aea-e914-4260-931a-fef2de011627 service nova] Enqueued Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_rules [ 630.086390] env[65678]: INFO networking_nsxv3.common.synchronization [req-ff86f2ed-7200-43a4-a40d-da57da019847 req-6c6a4aea-e914-4260-931a-fef2de011627 service nova] Enqueued Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_members [ 630.086390] env[65678]: INFO networking_nsxv3.common.synchronization [req-ff86f2ed-7200-43a4-a40d-da57da019847 req-6c6a4aea-e914-4260-931a-fef2de011627 service nova] Enqueued Resource ID: bff61bd7-6f22-4249-92c6-e1d881fe9148 with Priority: HIGHEST for action port [ 630.087562] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_rules [ 630.087712] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_members [ 630.087816] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bff61bd7-6f22-4249-92c6-e1d881fe9148 with Priority: HIGHEST for action port [ 630.088129] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40537b9d-ed59-4875-a8af-108e1322d055 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.088246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.088309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.088524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.088616] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.089858] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-40537b9d-ed59-4875-a8af-108e1322d055 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.090000] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.090084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.090260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.090984] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.090984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.090984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.091195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.091249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.091345] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.092189] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-bff61bd7-6f22-4249-92c6-e1d881fe9148 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.092352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bff61bd7-6f22-4249-92c6-e1d881fe9148" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.092352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bff61bd7-6f22-4249-92c6-e1d881fe9148" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.093707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bff61bd7-6f22-4249-92c6-e1d881fe9148" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.093707] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bff61bd7-6f22-4249-92c6-e1d881fe9148',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.237839] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.237990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.238348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.238588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.238684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.238884] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.238977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.239101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.239974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.239974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.239974] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db is going to be updated. [ 630.242298] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 850ea458-7bc9-41b1-87fe-f961a64609eb: rpc.has_security_group_logging(os_id): False [ 630.260655] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.260850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.260895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.261103] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.261192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.261589] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.261589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.261589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.261758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.261944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.261944] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 850ea458-7bc9-41b1-87fe-f961a64609eb is going to be created. [ 630.274436] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.274625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.274670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.274919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.275070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.288203] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: IN_PROGRESS for 2s [ 630.363981] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.364370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.364451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.364735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.364993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.381527] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 850ea458-7bc9-41b1-87fe-f961a64609eb in Status: IN_PROGRESS for 2s [ 630.595477] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-40537b9d-ed59-4875-a8af-108e1322d055 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.595638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.595868] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.596841] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bff61bd7-6f22-4249-92c6-e1d881fe9148 with status ACTIVE [ 630.597106] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.597235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.597303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.597503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.597587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.597765] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.597933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.597933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.598122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.598163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.598327] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.598414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.598523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.598611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.598671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.598759] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bff61bd7-6f22-4249-92c6-e1d881fe9148 is going to be updated. [ 630.626379] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.626379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.626379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.626379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.626379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.626379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bff61bd7-6f22-4249-92c6-e1d881fe9148" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.692896] env[65678]: INFO networking_nsxv3.common.synchronization [req-29e22acb-8bc7-4f41-9676-c2a2a77d041b req-76df42f5-b954-4f70-90b9-ca678c97feeb tempest-ServersWithSpecificFlavorTestJSON-1798572525 tempest-ServersWithSpecificFlavorTestJSON-1798572525-project-member] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 630.692896] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 630.692896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.692896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.692896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.692896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.696701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.696701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.696701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.696701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.696701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.697036] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.104530] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.125194] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.125428] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.125612] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.125834] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.126722] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.126938] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.127081] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.127330] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.127475] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.127685] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.127790] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.128073] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.128235] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.128430] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.128624] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.128863] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.151556] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.151742] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.152027] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.152132] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.152959] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.152959] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.152959] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.153395] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.153595] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.203953] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.204113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.204194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.204764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.204764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.204895] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.204977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.205069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.205253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.205346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.205482] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d6ddb-7487-401b-862b-e16865015657 already deleted. [ 631.205590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.343470] env[65678]: INFO networking_nsxv3.common.synchronization [None req-a335daac-6a5b-4581-80c5-966b203daf4b tempest-ServersTestFqdnHostnames-1424597037 tempest-ServersTestFqdnHostnames-1424597037-project-member] Enqueued Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_rules [ 631.343470] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_rules [ 631.343783] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.343927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.343986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.344251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.344897] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.434041] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8631425e-c832-4434-9322-1536d9e46bb8 in Status: SUCCESS [ 631.434326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.434518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.434753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.435070] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.435209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.435313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.435443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.435524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.435627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.435767] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8631425e-c832-4434-9322-1536d9e46bb8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.606704] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.606963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.606963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.607178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.607267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.607371] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40537b9d-ed59-4875-a8af-108e1322d055 is going to be created. [ 631.637476] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.637683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.637683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.637962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.638145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.650210] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40537b9d-ed59-4875-a8af-108e1322d055 in Status: UNINITIALIZED for 2s [ 631.653232] env[65678]: INFO networking_nsxv3.common.synchronization [None req-37a763a8-5872-4858-8893-70dbebffad9f None None] Enqueued Resource ID: 962b2ead-cb06-46ca-91b6-8bc0c76f8ae3 with Priority: HIGHEST for action port [ 631.654066] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 962b2ead-cb06-46ca-91b6-8bc0c76f8ae3 with Priority: HIGHEST for action port [ 631.654166] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-962b2ead-cb06-46ca-91b6-8bc0c76f8ae3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.654239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-962b2ead-cb06-46ca-91b6-8bc0c76f8ae3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.654300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-962b2ead-cb06-46ca-91b6-8bc0c76f8ae3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.654556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-962b2ead-cb06-46ca-91b6-8bc0c76f8ae3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.654630] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('962b2ead-cb06-46ca-91b6-8bc0c76f8ae3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.655976] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.656196] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.656287] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.656504] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.656679] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.656850] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d not found, creating... [ 631.657557] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.657557] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.657557] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.657557] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.657938] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.657983] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.658112] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.658229] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.659127] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.659127] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.659127] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d is going to be created. [ 631.681135] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.681355] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.681480] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.681750] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.681964] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.682202] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.866861] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.867306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.867473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.867795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.868283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.868669] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb already deleted. [ 631.868669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.937807] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8631425e-c832-4434-9322-1536d9e46bb8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.938041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.938186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.938510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.940258] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.940258] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8631425e-c832-4434-9322-1536d9e46bb8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.940258] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.940258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.940877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.940877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.940877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.940877] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8631425e-c832-4434-9322-1536d9e46bb8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.161117] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 962b2ead-cb06-46ca-91b6-8bc0c76f8ae3 [ 632.161538] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.161538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.161683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.162041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.162041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.162041] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:962b2ead-cb06-46ca-91b6-8bc0c76f8ae3 already deleted. [ 632.162041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-962b2ead-cb06-46ca-91b6-8bc0c76f8ae3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.303481] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: SUCCESS [ 632.303481] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db deletion is rescheduled due to dependency. [ 632.303481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.395436] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 850ea458-7bc9-41b1-87fe-f961a64609eb in Status: SUCCESS [ 632.395583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.428578] env[65678]: INFO networking_nsxv3.common.synchronization [req-29e22acb-8bc7-4f41-9676-c2a2a77d041b req-4b192f4c-f9f0-4b50-ace9-06b72181b217 service nova] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_rules [ 632.428786] env[65678]: INFO networking_nsxv3.common.synchronization [req-29e22acb-8bc7-4f41-9676-c2a2a77d041b req-4b192f4c-f9f0-4b50-ace9-06b72181b217 service nova] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 632.428994] env[65678]: INFO networking_nsxv3.common.synchronization [req-29e22acb-8bc7-4f41-9676-c2a2a77d041b req-4b192f4c-f9f0-4b50-ace9-06b72181b217 service nova] Enqueued Resource ID: aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d with Priority: HIGHEST for action port [ 632.429700] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_rules [ 632.429700] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 632.429917] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d with Priority: HIGHEST for action port [ 632.430152] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.430304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.430350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.430585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.430687] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.431570] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.431679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.431749] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.431917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.432195] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.432195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.432341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.432396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.432475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.432926] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.438037] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.438202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.438270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.438414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.438577] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.445165] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8631425e-c832-4434-9322-1536d9e46bb8: rpc.has_security_group_logging(os_id): False [ 632.470546] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.470546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.470546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.470546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.470546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.470546] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.470546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.470546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.470546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.470546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.470546] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.471317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.471370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.471634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.471801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.471943] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.472048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.472048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.472197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.472302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.472386] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8631425e-c832-4434-9322-1536d9e46bb8 is going to be created. [ 632.505064] env[65678]: INFO networking_nsxv3.common.synchronization [None req-d8de2182-635b-4c6b-9b50-2aef264e6fc4 tempest-ServersTestFqdnHostnames-1424597037 tempest-ServersTestFqdnHostnames-1424597037-project-member] Enqueued Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_rules [ 632.505873] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_rules [ 632.506311] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.506501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.506566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.506801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.506928] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.568356] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.568597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.568597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.569079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.569079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.582981] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8631425e-c832-4434-9322-1536d9e46bb8 in Status: IN_PROGRESS for 2s [ 632.941335] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.941499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.941696] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.943344] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d with status ACTIVE [ 632.943344] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.943344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.943344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.943344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.943344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.943672] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.943672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.943672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.943822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.943856] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.944457] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.944457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.944457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.944457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.944457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.944771] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d is going to be updated. [ 632.971216] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.971419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.971499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.971741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.971880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.973765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa2e8b34-ee9a-4265-afa7-26c2d5d41a9d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.028639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.028842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.028903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.029343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.029343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.029343] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb already deleted. [ 633.029343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.447928] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.563509] env[65678]: INFO networking_nsxv3.common.synchronization [None req-5011d714-4115-47df-ad14-de32583792c0 None None] Enqueued Resource ID: ed548e42-a704-4aa3-85c4-9e7f09a208ae with Priority: HIGHEST for action port [ 633.563509] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed548e42-a704-4aa3-85c4-9e7f09a208ae with Priority: HIGHEST for action port [ 633.563509] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed548e42-a704-4aa3-85c4-9e7f09a208ae taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.564017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed548e42-a704-4aa3-85c4-9e7f09a208ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.564247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed548e42-a704-4aa3-85c4-9e7f09a208ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.565614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed548e42-a704-4aa3-85c4-9e7f09a208ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.565614] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed548e42-a704-4aa3-85c4-9e7f09a208ae',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.662696] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40537b9d-ed59-4875-a8af-108e1322d055 in Status: SUCCESS [ 633.662958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.663210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.663392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.663593] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.663778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.664599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.664599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.664599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.664599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.664599] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.953199] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.953199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.953199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.953607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.954173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.954173] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d6ddb-7487-401b-862b-e16865015657 is going to be created. [ 633.989066] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.990620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.990620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.990620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.990620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.005523] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: UNINITIALIZED for 2s [ 634.067974] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed548e42-a704-4aa3-85c4-9e7f09a208ae [ 634.068222] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.068355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.068421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.069129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.069129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.069129] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed548e42-a704-4aa3-85c4-9e7f09a208ae already deleted. [ 634.069129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed548e42-a704-4aa3-85c4-9e7f09a208ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.172085] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.601812] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8631425e-c832-4434-9322-1536d9e46bb8 in Status: SUCCESS [ 634.602164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.676233] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40537b9d-ed59-4875-a8af-108e1322d055: rpc.has_security_group_logging(os_id): False [ 634.696264] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.696264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.696264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.696264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.696611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.696611] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.696900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.696900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.696900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.696900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.697079] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40537b9d-ed59-4875-a8af-108e1322d055 is going to be created. [ 634.767404] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.767897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.767897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.767897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.768158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.784427] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40537b9d-ed59-4875-a8af-108e1322d055 in Status: IN_PROGRESS for 2s [ 636.021570] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: SUCCESS [ 636.021570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.021570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.021570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.021570] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.021570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.021570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.021570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.021570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.021570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.021570] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.059689] env[65678]: INFO networking_nsxv3.common.synchronization [None req-eab5e501-5fc4-4169-89d5-52ab00c9e42f None None] Enqueued Resource ID: c665a298-a4aa-439b-ad21-b34dc05d422a with Priority: HIGHEST for action port [ 636.060286] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c665a298-a4aa-439b-ad21-b34dc05d422a with Priority: HIGHEST for action port [ 636.060806] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c665a298-a4aa-439b-ad21-b34dc05d422a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.060976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c665a298-a4aa-439b-ad21-b34dc05d422a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.061231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c665a298-a4aa-439b-ad21-b34dc05d422a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.061472] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c665a298-a4aa-439b-ad21-b34dc05d422a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.061569] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c665a298-a4aa-439b-ad21-b34dc05d422a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.086322] env[65678]: INFO networking_nsxv3.common.synchronization [req-6eff5251-d8f6-4d2e-800c-23208a92fb1c req-509053f9-9db8-42eb-bf01-e54a2808f6ba tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 636.086984] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 636.087365] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.087859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.087941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.090418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.090726] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.090981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.091073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.091329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.091462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.091588] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.524640] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.564606] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c665a298-a4aa-439b-ad21-b34dc05d422a [ 636.564683] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.566118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.566222] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.567054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.567054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.567054] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c665a298-a4aa-439b-ad21-b34dc05d422a already deleted. [ 636.567054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c665a298-a4aa-439b-ad21-b34dc05d422a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.594448] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.594745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.594745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.595900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.596044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.596267] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.596379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.596463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.596641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.596737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.596937] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d already deleted. [ 636.596937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.801489] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40537b9d-ed59-4875-a8af-108e1322d055 in Status: SUCCESS [ 636.801723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.030940] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 433d6ddb-7487-401b-862b-e16865015657: rpc.has_security_group_logging(os_id): False [ 637.051039] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.051197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.051255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.051471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.051563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.051811] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.051928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.051986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.052135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.052207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.052293] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433d6ddb-7487-401b-862b-e16865015657 is going to be created. [ 637.116594] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.116594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.116840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.117326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.117525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.130866] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: IN_PROGRESS for 2s [ 637.142147] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.142147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.142147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.142147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.142147] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.142147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.142147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.142147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.142147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.142147] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.142875] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.143145] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.143751] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.144103] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.144786] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.145082] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.166558] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.169404] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 637.169528] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.169721] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.170405] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.170405] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.170405] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.170948] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.170948] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('335e2048-d8cb-4a1a-b14d-da49f4f8b51f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.677734] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.678060] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.678255] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.678640] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.678856] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.679096] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 335e2048-d8cb-4a1a-b14d-da49f4f8b51f not found, creating... [ 637.679482] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.679711] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.679896] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.680417] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.680748] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.681258] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.681528] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.681768] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.682135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.682382] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.682703] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 335e2048-d8cb-4a1a-b14d-da49f4f8b51f is going to be created. [ 637.705864] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.706357] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.706357] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.706736] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.707226] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.707549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.772555] env[65678]: INFO networking_nsxv3.common.synchronization [None req-35176db9-70e8-41c6-ad73-eda89b35abe7 None None] Enqueued Resource ID: f1648662-956e-4d6a-86fd-551d4da5c1ca with Priority: HIGHEST for action port [ 637.773358] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1648662-956e-4d6a-86fd-551d4da5c1ca with Priority: HIGHEST for action port [ 637.773755] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1648662-956e-4d6a-86fd-551d4da5c1ca taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.773916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1648662-956e-4d6a-86fd-551d4da5c1ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.773992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1648662-956e-4d6a-86fd-551d4da5c1ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.774425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1648662-956e-4d6a-86fd-551d4da5c1ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.774559] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1648662-956e-4d6a-86fd-551d4da5c1ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.278169] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1648662-956e-4d6a-86fd-551d4da5c1ca [ 638.278169] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.278169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.278169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.278169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.278169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.278169] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1648662-956e-4d6a-86fd-551d4da5c1ca already deleted. [ 638.281023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1648662-956e-4d6a-86fd-551d4da5c1ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.458848] env[65678]: INFO networking_nsxv3.common.synchronization [req-6eff5251-d8f6-4d2e-800c-23208a92fb1c req-17fe5ec8-a10b-4995-9c7b-1e1960791e74 service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 638.459084] env[65678]: INFO networking_nsxv3.common.synchronization [req-6eff5251-d8f6-4d2e-800c-23208a92fb1c req-17fe5ec8-a10b-4995-9c7b-1e1960791e74 service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 638.459443] env[65678]: INFO networking_nsxv3.common.synchronization [req-6eff5251-d8f6-4d2e-800c-23208a92fb1c req-17fe5ec8-a10b-4995-9c7b-1e1960791e74 service nova] Enqueued Resource ID: 335e2048-d8cb-4a1a-b14d-da49f4f8b51f with Priority: HIGHEST for action port [ 638.462393] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 638.462478] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 638.462585] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 335e2048-d8cb-4a1a-b14d-da49f4f8b51f with Priority: HIGHEST for action port [ 638.463946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.464135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.465025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.465367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.465427] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.466750] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.466869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.466935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.467138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.467293] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.467388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.467442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.467592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.468272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.468272] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.469292] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.469399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.469480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.469624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.469695] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('335e2048-d8cb-4a1a-b14d-da49f4f8b51f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.972176] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.973299] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.973408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.973581] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 335e2048-d8cb-4a1a-b14d-da49f4f8b51f with status ACTIVE [ 638.973948] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.973948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.973948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.974153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.975042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.975042] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.975042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.975042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.975042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.975042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.975042] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.975640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.975640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.975640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.975758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.975828] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 335e2048-d8cb-4a1a-b14d-da49f4f8b51f is going to be updated. [ 638.999348] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.999490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.999555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.999783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.999920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.000099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-335e2048-d8cb-4a1a-b14d-da49f4f8b51f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.156937] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: SUCCESS [ 639.157076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.478418] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.982965] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.983199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.984037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.984037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.984037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.984037] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be created. [ 640.040415] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.040740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.040740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.041560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.041560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.056773] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: UNINITIALIZED for 2s [ 640.064684] env[65678]: INFO networking_nsxv3.common.synchronization [req-c6d422ea-92f5-4dfd-9fca-cd852e8b256f req-dbd70aaf-11ce-451b-8339-e106751cb3dc tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 640.068754] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 640.070376] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.070376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.070376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.070376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.070376] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.070376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.070376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.070376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.070864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.070864] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.551624] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.551624] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.551624] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.552808] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.553044] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.553239] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.553365] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.553678] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.553979] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.554102] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.554319] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.554319] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.554594] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.554594] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.554694] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.554809] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.576168] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.576452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.576452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.576722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.576722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.576914] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.577151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.577151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.577352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.577352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.577352] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 already deleted. [ 640.577723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.596193] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.596193] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.596193] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.596193] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.596193] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-bee23bcf-392d-4edb-af44-d172c51c8765 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.596193] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-bee23bcf-392d-4edb-af44-d172c51c8765" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.596193] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-bee23bcf-392d-4edb-af44-d172c51c8765" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.596705] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-bee23bcf-392d-4edb-af44-d172c51c8765" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.597024] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bee23bcf-392d-4edb-af44-d172c51c8765',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.100116] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.100378] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.100503] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.100823] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.100997] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.101201] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port bee23bcf-392d-4edb-af44-d172c51c8765 not found, creating... [ 641.101539] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.103051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.103051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.103051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.103051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.103051] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.103051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.103051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.103609] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.103609] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.103609] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: bee23bcf-392d-4edb-af44-d172c51c8765 is going to be created. [ 641.129509] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.129761] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.129902] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.130318] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.130978] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.130978] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-bee23bcf-392d-4edb-af44-d172c51c8765" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.571164] env[65678]: INFO networking_nsxv3.common.synchronization [None req-6b9d1681-6f41-477a-b593-1b22d605a08f None None] Enqueued Resource ID: d33c533c-da97-406c-b2f9-f1351fa45283 with Priority: HIGHEST for action port [ 641.571804] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d33c533c-da97-406c-b2f9-f1351fa45283 with Priority: HIGHEST for action port [ 641.572135] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d33c533c-da97-406c-b2f9-f1351fa45283 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.572905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d33c533c-da97-406c-b2f9-f1351fa45283" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.573072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d33c533c-da97-406c-b2f9-f1351fa45283" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.573364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d33c533c-da97-406c-b2f9-f1351fa45283" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.573527] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d33c533c-da97-406c-b2f9-f1351fa45283',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.879229] env[65678]: INFO networking_nsxv3.common.synchronization [req-c6d422ea-92f5-4dfd-9fca-cd852e8b256f req-5a8e5baa-8458-45ee-90d9-634b7c552f1f service nova] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_rules [ 641.879419] env[65678]: INFO networking_nsxv3.common.synchronization [req-c6d422ea-92f5-4dfd-9fca-cd852e8b256f req-5a8e5baa-8458-45ee-90d9-634b7c552f1f service nova] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 641.879552] env[65678]: INFO networking_nsxv3.common.synchronization [req-c6d422ea-92f5-4dfd-9fca-cd852e8b256f req-5a8e5baa-8458-45ee-90d9-634b7c552f1f service nova] Enqueued Resource ID: bee23bcf-392d-4edb-af44-d172c51c8765 with Priority: HIGHEST for action port [ 641.880215] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_rules [ 641.881594] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 641.881746] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bee23bcf-392d-4edb-af44-d172c51c8765 with Priority: HIGHEST for action port [ 641.882046] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.882172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.882432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.882594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.882594] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.884094] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.884165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.884165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.884348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.884496] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.884620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.884682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.884833] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.885238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.885365] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.887248] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-bee23bcf-392d-4edb-af44-d172c51c8765 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.887362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bee23bcf-392d-4edb-af44-d172c51c8765" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.887435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bee23bcf-392d-4edb-af44-d172c51c8765" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.887602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bee23bcf-392d-4edb-af44-d172c51c8765" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.888359] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bee23bcf-392d-4edb-af44-d172c51c8765',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.067230] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 642.067563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.067824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.068069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.068263] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.068386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.068448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.068593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.068672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.068757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.068846] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.075426] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d33c533c-da97-406c-b2f9-f1351fa45283 [ 642.075840] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.075840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.075840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.076012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.076097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.076199] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d33c533c-da97-406c-b2f9-f1351fa45283 already deleted. [ 642.076275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d33c533c-da97-406c-b2f9-f1351fa45283" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.385868] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.385868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.392583] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.394146] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bee23bcf-392d-4edb-af44-d172c51c8765 with status ACTIVE [ 642.394146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.394296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.394590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.394659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.395659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.395659] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.395659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.395659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.396525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.396525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.396637] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.396700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.396976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.396976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.396976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.397124] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bee23bcf-392d-4edb-af44-d172c51c8765 is going to be updated. [ 642.420415] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.421040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.421040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.421040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.421273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.421273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bee23bcf-392d-4edb-af44-d172c51c8765" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.572218] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.572218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.572218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.572218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.572666] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.572666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.572666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.572835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.573232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.573232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.573232] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.576159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.576159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.576159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.576159] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.576159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.576159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.576159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.576159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.576159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.576159] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.899345] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.077727] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d: rpc.has_security_group_logging(os_id): False [ 643.101468] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.101662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.101805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.101984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.102114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.102249] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.102404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.102404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.102558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.102633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.102904] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.103029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.103104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.103240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.103315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.104334] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.104470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.104544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.104680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.107118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.107118] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be created. [ 643.201696] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.201696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.201696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.201696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.201696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.215119] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 643.402071] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.405079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.405079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.405079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.405079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.405079] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 is going to be created. [ 643.432761] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.432761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.432761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.432761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.432761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.442718] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: UNINITIALIZED for 2s [ 644.156927] env[65678]: INFO networking_nsxv3.common.synchronization [None req-6015054b-45bc-461c-a763-6c1e56e1ad35 None None] Enqueued Resource ID: 4790c23a-f192-437f-90c1-386999ac948d with Priority: HIGHEST for action port [ 644.157282] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4790c23a-f192-437f-90c1-386999ac948d with Priority: HIGHEST for action port [ 644.157912] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-4790c23a-f192-437f-90c1-386999ac948d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.158107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4790c23a-f192-437f-90c1-386999ac948d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.158107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4790c23a-f192-437f-90c1-386999ac948d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.158371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4790c23a-f192-437f-90c1-386999ac948d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.158467] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4790c23a-f192-437f-90c1-386999ac948d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.588693] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e57d5f9f-0d37-4eed-a2e3-d14e2290b302 None None] Enqueued Resource ID: 306e3229-f5d8-4995-b0a2-69c544d5c2f8 with Priority: HIGHEST for action port [ 644.588693] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306e3229-f5d8-4995-b0a2-69c544d5c2f8 with Priority: HIGHEST for action port [ 644.588693] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-306e3229-f5d8-4995-b0a2-69c544d5c2f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.588693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-306e3229-f5d8-4995-b0a2-69c544d5c2f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.588693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-306e3229-f5d8-4995-b0a2-69c544d5c2f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.588693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-306e3229-f5d8-4995-b0a2-69c544d5c2f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.588693] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('306e3229-f5d8-4995-b0a2-69c544d5c2f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.662713] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4790c23a-f192-437f-90c1-386999ac948d [ 644.662713] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.662713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.662713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.663878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.665467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.665467] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4790c23a-f192-437f-90c1-386999ac948d already deleted. [ 644.665467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4790c23a-f192-437f-90c1-386999ac948d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.764106] env[65678]: INFO networking_nsxv3.common.synchronization [req-05300c6c-2599-4c82-a83b-d90943379b58 req-f2f550e8-dbc2-44ce-8415-86a0474d8f21 tempest-ServerAddressesTestJSON-928152806 tempest-ServerAddressesTestJSON-928152806-project-member] Enqueued Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGHEST for action security_group_members [ 644.764699] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGHEST for action security_group_members [ 644.767770] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54cf5e6-150a-4668-bddb-ef25e038e5cf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.767770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.767770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.767770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.767770] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.767770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.767770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.767770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.767770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.767770] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c54cf5e6-150a-4668-bddb-ef25e038e5cf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.090795] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 306e3229-f5d8-4995-b0a2-69c544d5c2f8 [ 645.091058] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.091205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.091277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.091486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.091574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.091667] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:306e3229-f5d8-4995-b0a2-69c544d5c2f8 already deleted. [ 645.091774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-306e3229-f5d8-4995-b0a2-69c544d5c2f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.142553] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.143126] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-787" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.143126] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-787" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.144126] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-787" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.144790] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.144956] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.145609] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.145997] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.146198] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.146411] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.147029] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.147029] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.147029] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.147029] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.147029] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.147270] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.167398] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.167738] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.167924] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.168170] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-787" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.168638] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-8952fca7-d858-4d9f-8c6c-144b0aa20155 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.168909] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-8952fca7-d858-4d9f-8c6c-144b0aa20155" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.169139] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-8952fca7-d858-4d9f-8c6c-144b0aa20155" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.169576] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-8952fca7-d858-4d9f-8c6c-144b0aa20155" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.169790] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8952fca7-d858-4d9f-8c6c-144b0aa20155',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.230046] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 645.230046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.257586] env[65678]: INFO networking_nsxv3.common.synchronization [None req-44e02941-c75a-4221-a57d-17cfb380e915 None None] Enqueued Resource ID: 9cdd688c-5817-4f55-b662-710ee266d363 with Priority: HIGHEST for action port [ 645.257858] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cdd688c-5817-4f55-b662-710ee266d363 with Priority: HIGHEST for action port [ 645.258476] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cdd688c-5817-4f55-b662-710ee266d363 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.258718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cdd688c-5817-4f55-b662-710ee266d363" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.258718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cdd688c-5817-4f55-b662-710ee266d363" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.258973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cdd688c-5817-4f55-b662-710ee266d363" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.259083] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cdd688c-5817-4f55-b662-710ee266d363',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.269669] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.269800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.269867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.270091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.270174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.270406] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.270823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.270823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.270823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.270823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.271012] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf already deleted. [ 645.271012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.455478] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: SUCCESS [ 645.455739] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.455919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.456401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.457128] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.457128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.457128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.457295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.457434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.458105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.458105] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.674859] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.674859] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.674859] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.675251] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.675403] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.675484] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 8952fca7-d858-4d9f-8c6c-144b0aa20155 not found, creating... [ 645.675748] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.675906] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.675978] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.676213] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.676456] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.676757] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.676757] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.676892] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.678030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.678030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.678030] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 8952fca7-d858-4d9f-8c6c-144b0aa20155 is going to be created. [ 645.704627] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.704627] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.704627] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.704627] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.704627] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.704627] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-8952fca7-d858-4d9f-8c6c-144b0aa20155" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.761160] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cdd688c-5817-4f55-b662-710ee266d363 [ 645.761851] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.762181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.762312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.762718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.762903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.763078] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cdd688c-5817-4f55-b662-710ee266d363 already deleted. [ 645.763222] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cdd688c-5817-4f55-b662-710ee266d363" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.959707] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.424726] env[65678]: INFO networking_nsxv3.common.synchronization [req-05300c6c-2599-4c82-a83b-d90943379b58 req-6eedba13-85e9-42b3-89f5-411840876e23 service nova] Enqueued Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGHEST for action security_group_rules [ 646.425057] env[65678]: INFO networking_nsxv3.common.synchronization [req-05300c6c-2599-4c82-a83b-d90943379b58 req-6eedba13-85e9-42b3-89f5-411840876e23 service nova] Enqueued Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGHEST for action security_group_members [ 646.425057] env[65678]: INFO networking_nsxv3.common.synchronization [req-05300c6c-2599-4c82-a83b-d90943379b58 req-6eedba13-85e9-42b3-89f5-411840876e23 service nova] Enqueued Resource ID: 8952fca7-d858-4d9f-8c6c-144b0aa20155 with Priority: HIGHEST for action port [ 646.425736] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGHEST for action security_group_rules [ 646.426708] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGHEST for action security_group_members [ 646.426708] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8952fca7-d858-4d9f-8c6c-144b0aa20155 with Priority: HIGHEST for action port [ 646.426708] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.426708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.426708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.426985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.426985] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c54cf5e6-150a-4668-bddb-ef25e038e5cf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.428437] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54cf5e6-150a-4668-bddb-ef25e038e5cf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.428549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.429618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.429618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.429618] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.429618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.429618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.429618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.429618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.429618] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c54cf5e6-150a-4668-bddb-ef25e038e5cf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.430647] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-8952fca7-d858-4d9f-8c6c-144b0aa20155 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.430647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8952fca7-d858-4d9f-8c6c-144b0aa20155" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.431921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8952fca7-d858-4d9f-8c6c-144b0aa20155" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.431921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8952fca7-d858-4d9f-8c6c-144b0aa20155" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.431921] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8952fca7-d858-4d9f-8c6c-144b0aa20155',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.464148] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 961e8451-f48b-412a-8046-631c24d72fe5: rpc.has_security_group_logging(os_id): False [ 646.484231] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.484601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.484601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.484697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.485281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.485281] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.485281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.485281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.485714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.485714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.485714] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 is going to be created. [ 646.598165] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.598165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.598165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.598534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.598534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.612608] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: IN_PROGRESS for 2s [ 646.780080] env[65678]: INFO networking_nsxv3.common.synchronization [req-5c891935-c2cf-4f2f-abf9-86bbf40d8d8c req-dadcfa19-e078-4dc1-a83f-f8cad70db106 tempest-FloatingIPsAssociationTestJSON-1218227649 tempest-FloatingIPsAssociationTestJSON-1218227649-project-member] Enqueued Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 646.781232] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 646.781232] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.781232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.781232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.781479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.781744] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.781744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.781744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.782108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.783100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.783100] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.935022] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c54cf5e6-150a-4668-bddb-ef25e038e5cf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.935192] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54cf5e6-150a-4668-bddb-ef25e038e5cf taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.935192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.935376] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8952fca7-d858-4d9f-8c6c-144b0aa20155 with status ACTIVE [ 646.935545] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.936152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.936270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.936498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.936584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.936769] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.936876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.936955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.937140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.937272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.937480] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.937576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.937636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.937780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.937850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.937933] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8952fca7-d858-4d9f-8c6c-144b0aa20155 is going to be updated. [ 647.035443] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.035443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.035443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.035443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.035756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.035756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8952fca7-d858-4d9f-8c6c-144b0aa20155" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.182645] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.183458] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-593" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.183458] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-593" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.185165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-593" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.185165] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.185165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.185165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.185165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.185165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.185165] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.185659] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.185659] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.185659] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.185659] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.185659] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.185970] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.215845] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.216014] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.216186] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.216420] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-593" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.216817] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-76687361-0896-494e-9b0f-2e8e2b300f66 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.216999] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-76687361-0896-494e-9b0f-2e8e2b300f66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.217129] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-76687361-0896-494e-9b0f-2e8e2b300f66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.217441] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-76687361-0896-494e-9b0f-2e8e2b300f66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.217572] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76687361-0896-494e-9b0f-2e8e2b300f66',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.286874] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.440498] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c54cf5e6-150a-4668-bddb-ef25e038e5cf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.722496] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.722496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.722496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.722496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.722496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.722868] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 76687361-0896-494e-9b0f-2e8e2b300f66 not found, creating... [ 647.723112] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.723590] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.723776] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.724152] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.724421] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.724830] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.725123] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.725230] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.725605] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.725829] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.726083] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 76687361-0896-494e-9b0f-2e8e2b300f66 is going to be created. [ 647.747990] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.747990] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.748152] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.748334] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.748547] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.748767] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-76687361-0896-494e-9b0f-2e8e2b300f66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.788540] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.943104] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.943524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.943755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.945180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.945180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.945180] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf is going to be created. [ 647.971226] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.971370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.971438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.971677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.971885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.987365] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf in Status: UNINITIALIZED for 2s [ 648.291500] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.291884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.291884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.293125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.293125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.293125] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9497cc12-615a-4090-934d-a1b00059825f is going to be updated. [ 648.335373] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.335373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.335373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.335373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.335373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.345769] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: IN_PROGRESS for 2s [ 648.521327] env[65678]: INFO networking_nsxv3.common.synchronization [req-5c891935-c2cf-4f2f-abf9-86bbf40d8d8c req-f4e898b2-0eca-48f2-8e46-56c3016bcc3a service nova] Enqueued Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_rules [ 648.521625] env[65678]: INFO networking_nsxv3.common.synchronization [req-5c891935-c2cf-4f2f-abf9-86bbf40d8d8c req-f4e898b2-0eca-48f2-8e46-56c3016bcc3a service nova] Enqueued Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 648.521625] env[65678]: INFO networking_nsxv3.common.synchronization [req-5c891935-c2cf-4f2f-abf9-86bbf40d8d8c req-f4e898b2-0eca-48f2-8e46-56c3016bcc3a service nova] Enqueued Resource ID: 76687361-0896-494e-9b0f-2e8e2b300f66 with Priority: HIGHEST for action port [ 648.522084] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_rules [ 648.522639] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 648.522639] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76687361-0896-494e-9b0f-2e8e2b300f66 with Priority: HIGHEST for action port [ 648.522639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.522871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.522871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.522962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.523702] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.524823] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.524823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.524984] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-76687361-0896-494e-9b0f-2e8e2b300f66 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.525660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76687361-0896-494e-9b0f-2e8e2b300f66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.525660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76687361-0896-494e-9b0f-2e8e2b300f66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.525660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76687361-0896-494e-9b0f-2e8e2b300f66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.525660] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76687361-0896-494e-9b0f-2e8e2b300f66',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.629294] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: SUCCESS [ 648.629579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.029170] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76687361-0896-494e-9b0f-2e8e2b300f66 with status ACTIVE [ 649.029170] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.029170] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.029170] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.029170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.029170] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76687361-0896-494e-9b0f-2e8e2b300f66 is going to be updated. [ 649.030695] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.030695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.055429] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.055736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.055855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.056127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.056294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.056594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76687361-0896-494e-9b0f-2e8e2b300f66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.625537] env[65678]: INFO networking_nsxv3.common.synchronization [None req-b64faee5-1740-4c62-8197-1200ec1c28cb None None] Enqueued Resource ID: 9e659fe3-2097-4c99-8666-8250236088d2 with Priority: HIGHEST for action port [ 649.626532] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e659fe3-2097-4c99-8666-8250236088d2 with Priority: HIGHEST for action port [ 649.626921] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e659fe3-2097-4c99-8666-8250236088d2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.627072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e659fe3-2097-4c99-8666-8250236088d2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.627192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e659fe3-2097-4c99-8666-8250236088d2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.627433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e659fe3-2097-4c99-8666-8250236088d2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.627556] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e659fe3-2097-4c99-8666-8250236088d2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.999483] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf in Status: SUCCESS [ 649.999483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.999689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.999765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.999952] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.000083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.000142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.000300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.000909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.000909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.000909] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c54cf5e6-150a-4668-bddb-ef25e038e5cf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.132480] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e659fe3-2097-4c99-8666-8250236088d2 [ 650.132480] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.132480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.132480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.132480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.132480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.132480] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e659fe3-2097-4c99-8666-8250236088d2 already deleted. [ 650.132480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e659fe3-2097-4c99-8666-8250236088d2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.358022] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: SUCCESS [ 650.358022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.358022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.358022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.358022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.358022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.358022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.358022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.358022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.358022] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.503550] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54cf5e6-150a-4668-bddb-ef25e038e5cf taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.503550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.503956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.503956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.504835] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.504835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.504835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.504835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.504835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.504835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.505430] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54cf5e6-150a-4668-bddb-ef25e038e5cf taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.505430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.505430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.505731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.505731] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.505731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.505958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.505958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.506049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.506049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.506399] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c54cf5e6-150a-4668-bddb-ef25e038e5cf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.863030] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.865356] env[65678]: INFO networking_nsxv3.common.synchronization [None req-fd09b2a1-d049-4a2e-9ebe-4ccadbc618d7 None None] Enqueued Resource ID: d3df6355-f350-46ac-a826-b64a52180645 with Priority: HIGHEST for action port [ 650.866153] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3df6355-f350-46ac-a826-b64a52180645 with Priority: HIGHEST for action port [ 650.866464] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3df6355-f350-46ac-a826-b64a52180645 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.866592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3df6355-f350-46ac-a826-b64a52180645" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.866661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3df6355-f350-46ac-a826-b64a52180645" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.866917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3df6355-f350-46ac-a826-b64a52180645" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.866997] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3df6355-f350-46ac-a826-b64a52180645',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.009164] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c54cf5e6-150a-4668-bddb-ef25e038e5cf: rpc.has_security_group_logging(os_id): False [ 651.030231] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.030431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.030499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.030742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.030841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.031065] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.031283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.031283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.032154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.032154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.032154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.032154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.032154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.032154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.032599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.032694] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.032773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.032883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.033235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.033235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.033235] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf is going to be created. [ 651.096138] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.096409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.096409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.096579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.100401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.118528] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf in Status: IN_PROGRESS for 2s [ 651.360112] env[65678]: INFO networking_nsxv3.common.synchronization [req-d65fafc5-8dcf-4c46-84e6-e43c9dbb3caf req-0ab4509e-1c7f-43e1-ac8b-4f74e542fcdf tempest-ImagesOneServerTestJSON-224947826 tempest-ImagesOneServerTestJSON-224947826-project-member] Enqueued Resource ID: be3b7ec3-66f8-4175-9611-636d9a427a3e with Priority: HIGHEST for action security_group_members [ 651.360723] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be3b7ec3-66f8-4175-9611-636d9a427a3e with Priority: HIGHEST for action security_group_members [ 651.361277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3b7ec3-66f8-4175-9611-636d9a427a3e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.361427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.361491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.361806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.362862] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.362862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.362862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.362862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.363135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.363135] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be3b7ec3-66f8-4175-9611-636d9a427a3e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.369321] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.371034] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3df6355-f350-46ac-a826-b64a52180645 [ 651.371387] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.371640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.371812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.372090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.372281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.377115] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3df6355-f350-46ac-a826-b64a52180645 already deleted. [ 651.377115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3df6355-f350-46ac-a826-b64a52180645" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.846534] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.847018] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-465" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.847282] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-465" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.847698] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-465" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.848184] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.848505] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.848731] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.849097] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.849358] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.850981] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.850981] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.850981] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.850981] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.850981] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.850981] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.850981] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.866213] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.866815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.867200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.868666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.868666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.868666] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.868666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.868666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.868666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.868666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.868666] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be3b7ec3-66f8-4175-9611-636d9a427a3e already deleted. [ 651.868666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.880022] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.880022] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 651.880022] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.880022] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-465" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.880022] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-389cf1fd-f864-4d05-bb7a-d12642e271df taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.880022] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-389cf1fd-f864-4d05-bb7a-d12642e271df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.880022] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-389cf1fd-f864-4d05-bb7a-d12642e271df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.880022] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-389cf1fd-f864-4d05-bb7a-d12642e271df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.880022] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('389cf1fd-f864-4d05-bb7a-d12642e271df',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.880938] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.881310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.881536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.881881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.882239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.882437] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9497cc12-615a-4090-934d-a1b00059825f is going to be updated. [ 651.920229] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.920519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.921421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.921651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.921799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.934248] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: IN_PROGRESS for 2s [ 652.255143] env[65678]: INFO networking_nsxv3.common.synchronization [None req-d4e45e4e-7e94-4abb-a301-4d56aca59139 None None] Enqueued Resource ID: e354442e-fdb1-4a58-b316-fa7b7a8d9a57 with Priority: HIGHEST for action port [ 652.256552] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e354442e-fdb1-4a58-b316-fa7b7a8d9a57 with Priority: HIGHEST for action port [ 652.256552] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-e354442e-fdb1-4a58-b316-fa7b7a8d9a57 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.256552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e354442e-fdb1-4a58-b316-fa7b7a8d9a57" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.256552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e354442e-fdb1-4a58-b316-fa7b7a8d9a57" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.256552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e354442e-fdb1-4a58-b316-fa7b7a8d9a57" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.260194] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e354442e-fdb1-4a58-b316-fa7b7a8d9a57',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.385431] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.385776] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.385859] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.386252] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.386355] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.386536] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 389cf1fd-f864-4d05-bb7a-d12642e271df not found, creating... [ 652.386864] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.387899] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.388018] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.388399] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.388694] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.389518] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.389717] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.389875] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.390133] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.390264] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.390405] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 389cf1fd-f864-4d05-bb7a-d12642e271df is going to be created. [ 652.415921] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.416187] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.416683] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.417378] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.417378] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.417500] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-389cf1fd-f864-4d05-bb7a-d12642e271df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.759073] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e354442e-fdb1-4a58-b316-fa7b7a8d9a57 [ 652.759370] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.760192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.760375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.760848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.760848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.760848] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e354442e-fdb1-4a58-b316-fa7b7a8d9a57 already deleted. [ 652.760848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e354442e-fdb1-4a58-b316-fa7b7a8d9a57" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.135122] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf in Status: SUCCESS [ 653.135447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.140885] env[65678]: INFO networking_nsxv3.common.synchronization [req-d65fafc5-8dcf-4c46-84e6-e43c9dbb3caf req-a0b576fc-0794-410d-b01f-e6991dd824ca service nova] Enqueued Resource ID: be3b7ec3-66f8-4175-9611-636d9a427a3e with Priority: HIGHEST for action security_group_rules [ 653.140885] env[65678]: INFO networking_nsxv3.common.synchronization [req-d65fafc5-8dcf-4c46-84e6-e43c9dbb3caf req-a0b576fc-0794-410d-b01f-e6991dd824ca service nova] Enqueued Resource ID: be3b7ec3-66f8-4175-9611-636d9a427a3e with Priority: HIGHEST for action security_group_members [ 653.140885] env[65678]: INFO networking_nsxv3.common.synchronization [req-d65fafc5-8dcf-4c46-84e6-e43c9dbb3caf req-a0b576fc-0794-410d-b01f-e6991dd824ca service nova] Enqueued Resource ID: 389cf1fd-f864-4d05-bb7a-d12642e271df with Priority: HIGHEST for action port [ 653.140885] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be3b7ec3-66f8-4175-9611-636d9a427a3e with Priority: HIGHEST for action security_group_rules [ 653.142076] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be3b7ec3-66f8-4175-9611-636d9a427a3e with Priority: HIGHEST for action security_group_members [ 653.142359] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 389cf1fd-f864-4d05-bb7a-d12642e271df with Priority: HIGHEST for action port [ 653.142795] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be3b7ec3-66f8-4175-9611-636d9a427a3e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.143320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.143561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.143930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.144160] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be3b7ec3-66f8-4175-9611-636d9a427a3e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.147012] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3b7ec3-66f8-4175-9611-636d9a427a3e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.147486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.147601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.149589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.149589] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.149589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.149780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.149818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.150709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.150790] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be3b7ec3-66f8-4175-9611-636d9a427a3e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.151729] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-389cf1fd-f864-4d05-bb7a-d12642e271df taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.151861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-389cf1fd-f864-4d05-bb7a-d12642e271df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.151928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-389cf1fd-f864-4d05-bb7a-d12642e271df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.152117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-389cf1fd-f864-4d05-bb7a-d12642e271df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.152195] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('389cf1fd-f864-4d05-bb7a-d12642e271df',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.262374] env[65678]: INFO networking_nsxv3.common.synchronization [None req-900a37b8-8578-46f4-8810-2da9fe83a13f None None] Enqueued Resource ID: 7eeb0034-5e4a-4ecc-a55b-5fa2edad0220 with Priority: HIGHEST for action port [ 653.262963] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eeb0034-5e4a-4ecc-a55b-5fa2edad0220 with Priority: HIGHEST for action port [ 653.263371] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-7eeb0034-5e4a-4ecc-a55b-5fa2edad0220 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.263571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7eeb0034-5e4a-4ecc-a55b-5fa2edad0220" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.263644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7eeb0034-5e4a-4ecc-a55b-5fa2edad0220" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.263923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7eeb0034-5e4a-4ecc-a55b-5fa2edad0220" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.264047] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7eeb0034-5e4a-4ecc-a55b-5fa2edad0220',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.648668] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3b7ec3-66f8-4175-9611-636d9a427a3e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.648668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.654251] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be3b7ec3-66f8-4175-9611-636d9a427a3e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.655708] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 389cf1fd-f864-4d05-bb7a-d12642e271df with status ACTIVE [ 653.655963] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.656175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.656225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.656405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.657022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.657022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.657022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.657022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.657022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.657022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.657389] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.657389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.657389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.657508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.657544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.657624] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 389cf1fd-f864-4d05-bb7a-d12642e271df is going to be updated. [ 653.693536] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.693536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.693536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.693536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.693536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.694011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-389cf1fd-f864-4d05-bb7a-d12642e271df" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.766242] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7eeb0034-5e4a-4ecc-a55b-5fa2edad0220 [ 653.766585] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.766819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.766887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.767110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.767244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.767365] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7eeb0034-5e4a-4ecc-a55b-5fa2edad0220 already deleted. [ 653.767493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7eeb0034-5e4a-4ecc-a55b-5fa2edad0220" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.947675] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: SUCCESS [ 653.947942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.948134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.948370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.949079] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.949079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.949079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.949079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.949079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.949429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.949429] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.160179] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be3b7ec3-66f8-4175-9611-636d9a427a3e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.451531] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.455093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.455226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.455477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.456073] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.456680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.456680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.456680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.456680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.456680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.457149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.457149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.457245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.459042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.459042] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.459042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.459042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.459042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.459042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.459042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.459042] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.663639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.664836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.664836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.664836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.664836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.664836] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be3b7ec3-66f8-4175-9611-636d9a427a3e is going to be created. [ 654.697802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.697802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.697802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.697802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.697802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.713988] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be3b7ec3-66f8-4175-9611-636d9a427a3e in Status: UNINITIALIZED for 2s [ 654.960799] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9497cc12-615a-4090-934d-a1b00059825f: rpc.has_security_group_logging(os_id): False [ 654.980064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.980226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.980317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.980501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.980624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.980828] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.980936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.980999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.981172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.981300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.981561] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.981561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.981703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.981757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.981838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.982068] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.982175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.982229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.982386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.982762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.982762] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9497cc12-615a-4090-934d-a1b00059825f is going to be updated. [ 655.051982] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.052266] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.052347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.053208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.053208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.066370] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: IN_PROGRESS for 2s [ 656.730971] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be3b7ec3-66f8-4175-9611-636d9a427a3e in Status: SUCCESS [ 656.731492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.735506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.735506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.735506] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.735506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.735506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.735506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.735506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.735506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.735506] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be3b7ec3-66f8-4175-9611-636d9a427a3e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.040093] env[65678]: INFO networking_nsxv3.common.synchronization [req-f153a8ce-dff8-47c2-999e-3bc4a80b7563 req-0cff610f-fd6d-45bf-99fe-4e92d599eb99 tempest-ServersTestFqdnHostnames-1424597037 tempest-ServersTestFqdnHostnames-1424597037-project-member] Enqueued Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_members [ 657.040093] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_members [ 657.040093] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.040093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.040093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.041161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.041303] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.041556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.041556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.041686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.041738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.041802] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.083192] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: SUCCESS [ 657.083410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.235858] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3b7ec3-66f8-4175-9611-636d9a427a3e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.235985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.236276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.237164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.237996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.238150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.238272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.238524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.238524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.238629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.238841] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3b7ec3-66f8-4175-9611-636d9a427a3e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.238841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.238963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.240176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.240176] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.240176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.240176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.240176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.240176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.240176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.240176] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be3b7ec3-66f8-4175-9611-636d9a427a3e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.523455] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.523746] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-525" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.523908] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-525" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.524254] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-525" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.524534] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.524703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.524822] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.525081] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.525228] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.525429] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.525549] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.525643] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.525747] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.525852] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.525969] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.526113] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.544580] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.544797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.544797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.544996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.545109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.545295] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.545419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.545480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.545633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.545711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.545834] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb already deleted. [ 657.545919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.550826] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.551012] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.551122] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.551280] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-525" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.551560] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-5489ba09-b316-4787-a2fb-b54ecfcc336e taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.551718] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-5489ba09-b316-4787-a2fb-b54ecfcc336e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.551834] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-5489ba09-b316-4787-a2fb-b54ecfcc336e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.552141] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-5489ba09-b316-4787-a2fb-b54ecfcc336e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.552276] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5489ba09-b316-4787-a2fb-b54ecfcc336e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.742273] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be3b7ec3-66f8-4175-9611-636d9a427a3e: rpc.has_security_group_logging(os_id): False [ 657.762801] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.762981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.763096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.763324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.763441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.763725] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.763823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.763823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.764086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.764086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.764317] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.764433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.764496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.764638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.764724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.764908] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.765045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.765106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.765216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.765301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.765388] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be3b7ec3-66f8-4175-9611-636d9a427a3e is going to be created. [ 657.832116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.832116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.832116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.832116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.832116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.843979] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be3b7ec3-66f8-4175-9611-636d9a427a3e in Status: IN_PROGRESS for 2s [ 658.057036] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.057036] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.057036] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.057036] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.057036] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.057036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 5489ba09-b316-4787-a2fb-b54ecfcc336e not found, creating... [ 658.057618] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.057840] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.057890] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.058164] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.058301] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.058585] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.058735] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.058847] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.059069] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.059204] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.059333] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 5489ba09-b316-4787-a2fb-b54ecfcc336e is going to be created. [ 658.084547] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.084804] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.084867] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.085167] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.085390] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.085668] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-5489ba09-b316-4787-a2fb-b54ecfcc336e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.864442] env[65678]: INFO networking_nsxv3.common.synchronization [req-f153a8ce-dff8-47c2-999e-3bc4a80b7563 req-8873cc75-57a6-434a-a6a3-5fea67541fc4 service nova] Enqueued Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_rules [ 658.864711] env[65678]: INFO networking_nsxv3.common.synchronization [req-f153a8ce-dff8-47c2-999e-3bc4a80b7563 req-8873cc75-57a6-434a-a6a3-5fea67541fc4 service nova] Enqueued Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_members [ 658.864827] env[65678]: INFO networking_nsxv3.common.synchronization [req-f153a8ce-dff8-47c2-999e-3bc4a80b7563 req-8873cc75-57a6-434a-a6a3-5fea67541fc4 service nova] Enqueued Resource ID: 5489ba09-b316-4787-a2fb-b54ecfcc336e with Priority: HIGHEST for action port [ 658.865442] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_rules [ 658.865583] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_members [ 658.865680] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5489ba09-b316-4787-a2fb-b54ecfcc336e with Priority: HIGHEST for action port [ 658.866286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.866409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.866481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.866682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.866764] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.867592] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.867701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.867770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.867968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.868083] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.868218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.868318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.868479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.868563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.868653] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.870462] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-5489ba09-b316-4787-a2fb-b54ecfcc336e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.870462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5489ba09-b316-4787-a2fb-b54ecfcc336e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.870462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5489ba09-b316-4787-a2fb-b54ecfcc336e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.870462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5489ba09-b316-4787-a2fb-b54ecfcc336e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.870462] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5489ba09-b316-4787-a2fb-b54ecfcc336e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.358987] env[65678]: INFO networking_nsxv3.common.synchronization [req-1934e68b-ddac-4b4a-a73a-bb856dc093ff req-eb6504a8-1537-494d-99d3-16b0ac23420e tempest-ListServerFiltersTestJSON-129772598 tempest-ListServerFiltersTestJSON-129772598-project-member] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 659.359451] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 659.359801] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.359926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.359988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.360398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.360563] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.360683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.360743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.360912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.360998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.361100] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.364631] env[65678]: INFO networking_nsxv3.common.synchronization [req-a36c06d9-3941-42e8-88ea-e6f29065aeb5 req-4ab6520b-3880-4327-9340-4c12a4eddbdb tempest-InstanceActionsNegativeTestJSON-874151880 tempest-InstanceActionsNegativeTestJSON-874151880-project-member] Enqueued Resource ID: 8631425e-c832-4434-9322-1536d9e46bb8 with Priority: HIGHEST for action security_group_members [ 659.364997] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8631425e-c832-4434-9322-1536d9e46bb8 with Priority: HIGHEST for action security_group_members [ 659.365307] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8631425e-c832-4434-9322-1536d9e46bb8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.365431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.365515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.365680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.365846] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.365945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.366119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.366160] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.366249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.366349] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8631425e-c832-4434-9322-1536d9e46bb8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.371012] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.372330] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.372480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.372959] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5489ba09-b316-4787-a2fb-b54ecfcc336e with status ACTIVE [ 659.373153] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.373341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.373341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.373558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.373631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.373794] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.373886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.373950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.374156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.374206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.374485] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.374874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.374987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.375118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.375204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.375294] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5489ba09-b316-4787-a2fb-b54ecfcc336e is going to be updated. [ 659.405604] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.405856] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.405934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.406241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.406419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.406700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5489ba09-b316-4787-a2fb-b54ecfcc336e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.841807] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-726 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.841994] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.842142] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.842533] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.844868] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.845144] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.845303] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.846164] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.846356] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.847279] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.847447] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.847595] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.847733] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.847873] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.848018] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.848205] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.865380] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.865676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.865676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.865995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.865995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.866223] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.866334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.866405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.866637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.866704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.866792] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 already deleted. [ 659.866872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.868125] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be3b7ec3-66f8-4175-9611-636d9a427a3e in Status: SUCCESS [ 659.868336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.869079] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.869248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.869328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.869564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.869680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.870097] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.870097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.870260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.870362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.870461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.870552] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8631425e-c832-4434-9322-1536d9e46bb8 is going to be updated. [ 659.873608] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.873608] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.873608] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.873608] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.873608] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.874157] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.874295] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.874628] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.874806] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39cf815c-9eed-4ef5-8f66-8310a6b8a8e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.876573] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.919412] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.919614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.919750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.920821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.921021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.936807] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8631425e-c832-4434-9322-1536d9e46bb8 in Status: IN_PROGRESS for 2s [ 660.377741] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.381161] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.381161] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.381161] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.381161] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.381161] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 39cf815c-9eed-4ef5-8f66-8310a6b8a8e2 not found, creating... [ 660.381161] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.381161] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.381161] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.381161] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.381161] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.381709] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.381709] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.381709] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.382437] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.382850] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.383220] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 39cf815c-9eed-4ef5-8f66-8310a6b8a8e2 is going to be created. [ 660.386154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.388141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.388141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.388141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.388141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.388141] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb is going to be created. [ 660.416329] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.416544] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.416674] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.416966] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.417204] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.417424] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.420548] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.422807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.422851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.423067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.423221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.437497] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb in Status: UNINITIALIZED for 2s [ 661.142619] env[65678]: INFO networking_nsxv3.common.synchronization [req-1934e68b-ddac-4b4a-a73a-bb856dc093ff req-246fd371-6ffa-4fb3-9e85-2cca6b096601 service nova] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_rules [ 661.143119] env[65678]: INFO networking_nsxv3.common.synchronization [req-1934e68b-ddac-4b4a-a73a-bb856dc093ff req-246fd371-6ffa-4fb3-9e85-2cca6b096601 service nova] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 661.143119] env[65678]: INFO networking_nsxv3.common.synchronization [req-1934e68b-ddac-4b4a-a73a-bb856dc093ff req-246fd371-6ffa-4fb3-9e85-2cca6b096601 service nova] Enqueued Resource ID: 39cf815c-9eed-4ef5-8f66-8310a6b8a8e2 with Priority: HIGHEST for action port [ 661.143503] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_rules [ 661.143723] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 661.144409] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39cf815c-9eed-4ef5-8f66-8310a6b8a8e2 with Priority: HIGHEST for action port [ 661.145051] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.145051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.145051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.145386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.145462] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.146462] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.146530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.146630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.146927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.147066] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.147182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.147249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.147525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.147525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.147689] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.149447] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.149520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.149660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.149805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.149892] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39cf815c-9eed-4ef5-8f66-8310a6b8a8e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.651593] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.657064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.657064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.657064] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39cf815c-9eed-4ef5-8f66-8310a6b8a8e2 with status ACTIVE [ 661.657064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.657064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.657064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.657064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.657064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.657064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.657064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.657064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.657064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.657064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.657064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.657993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.657993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.657993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.657993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.657993] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39cf815c-9eed-4ef5-8f66-8310a6b8a8e2 is going to be updated. [ 661.689059] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.689314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.689712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.689712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.689861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.690160] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39cf815c-9eed-4ef5-8f66-8310a6b8a8e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.948098] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8631425e-c832-4434-9322-1536d9e46bb8 in Status: SUCCESS [ 661.948098] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8631425e-c832-4434-9322-1536d9e46bb8 deletion is rescheduled due to dependency. [ 661.948298] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8631425e-c832-4434-9322-1536d9e46bb8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.089421] env[65678]: INFO networking_nsxv3.common.synchronization [req-f0e4291f-89ef-464a-9148-f32c9a2b3b37 req-a6044400-2a96-4655-9113-9984d7d25b8d tempest-ServerAddressesNegativeTestJSON-1897348883 tempest-ServerAddressesNegativeTestJSON-1897348883-project-member] Enqueued Resource ID: cddb9167-1b9c-4751-8cf3-4f83a593874e with Priority: HIGHEST for action security_group_members [ 662.089998] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddb9167-1b9c-4751-8cf3-4f83a593874e with Priority: HIGHEST for action security_group_members [ 662.090339] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddb9167-1b9c-4751-8cf3-4f83a593874e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.090452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.090516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.090792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.091411] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.091411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.091411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.091411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.091411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.091733] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddb9167-1b9c-4751-8cf3-4f83a593874e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.155297] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.447824] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb in Status: SUCCESS [ 662.448274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.448478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.448706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.448904] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.449046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.449113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.449272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.449353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.449442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.449531] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.473210] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-462 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.473210] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-462" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.473455] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-462" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.473858] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-462" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.474233] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.474452] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.474614] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.474891] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.475099] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.475367] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.475527] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.475736] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.475990] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.476230] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.476438] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.476626] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.496259] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.496431] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.496567] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.496746] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-462" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.497065] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.497422] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.497422] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.497656] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.497789] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.593168] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.594709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.594709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.594709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.594709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.594709] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.594709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.594709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.595050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.595050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.595209] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddb9167-1b9c-4751-8cf3-4f83a593874e already deleted. [ 662.595307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.658118] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.658315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.658408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.659634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.659634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.659634] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be created. [ 662.691036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.691241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.691302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.691473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.692661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.702484] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: UNINITIALIZED for 2s [ 662.954025] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.000422] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.000693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.000790] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.001105] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.001255] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.001409] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9 not found, creating... [ 663.001685] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.001847] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.001961] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.002229] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.002364] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.002731] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.002858] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.002972] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.004840] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.005404] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.005404] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9 is going to be created. [ 663.036730] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.037093] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.037276] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.037674] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.037978] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.038385] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.455765] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb: rpc.has_security_group_logging(os_id): False [ 663.473473] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.473719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.473719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.473923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.474783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.474783] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.474783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.474783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.474783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.474783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.475109] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb is going to be created. [ 663.550975] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.551211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.551211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.552888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.552888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.567840] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb in Status: IN_PROGRESS for 2s [ 663.792403] env[65678]: INFO networking_nsxv3.common.synchronization [req-f0e4291f-89ef-464a-9148-f32c9a2b3b37 req-92c690de-9d9f-4e1e-84df-3335bc289597 service nova] Enqueued Resource ID: cddb9167-1b9c-4751-8cf3-4f83a593874e with Priority: HIGHEST for action security_group_rules [ 663.792403] env[65678]: INFO networking_nsxv3.common.synchronization [req-f0e4291f-89ef-464a-9148-f32c9a2b3b37 req-92c690de-9d9f-4e1e-84df-3335bc289597 service nova] Enqueued Resource ID: cddb9167-1b9c-4751-8cf3-4f83a593874e with Priority: HIGHEST for action security_group_members [ 663.792403] env[65678]: INFO networking_nsxv3.common.synchronization [req-f0e4291f-89ef-464a-9148-f32c9a2b3b37 req-92c690de-9d9f-4e1e-84df-3335bc289597 service nova] Enqueued Resource ID: 3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9 with Priority: HIGHEST for action port [ 663.792403] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddb9167-1b9c-4751-8cf3-4f83a593874e with Priority: HIGHEST for action security_group_rules [ 663.792403] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddb9167-1b9c-4751-8cf3-4f83a593874e with Priority: HIGHEST for action security_group_members [ 663.792403] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9 with Priority: HIGHEST for action port [ 663.792403] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cddb9167-1b9c-4751-8cf3-4f83a593874e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.792403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.792403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.792403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.792403] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cddb9167-1b9c-4751-8cf3-4f83a593874e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.793296] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddb9167-1b9c-4751-8cf3-4f83a593874e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.793296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.793296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.793296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.793440] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.793440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.793532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.794324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.794390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.794824] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddb9167-1b9c-4751-8cf3-4f83a593874e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.796065] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.796717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.796717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.796717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.796858] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.298907] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddb9167-1b9c-4751-8cf3-4f83a593874e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.299082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.299294] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cddb9167-1b9c-4751-8cf3-4f83a593874e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.300641] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9 with status ACTIVE [ 664.300917] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.301069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.301130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.301350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.301442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.301637] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.301747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.301802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.301944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.302351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.302639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.302815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.302878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.303128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.303237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.303421] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9 is going to be updated. [ 664.342071] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.342295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.342415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.342573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.342801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.343045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ae8099e-f5b6-4cf4-a1ee-2075cc090ad9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.719029] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 664.719029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.719029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.719029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.719029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.719029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.719029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.719029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.719029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.720176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.720441] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.805444] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cddb9167-1b9c-4751-8cf3-4f83a593874e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.955596] env[65678]: INFO networking_nsxv3.common.synchronization [req-a1f5169c-3b0f-4a14-bf3f-264f49327606 req-45831e1d-754a-4c0f-a336-dca58030ed2b tempest-DeleteServersAdminTestJSON-1802841318 tempest-DeleteServersAdminTestJSON-1802841318-project-member] Enqueued Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 664.955596] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 664.957288] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.957830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.958082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.958743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.959101] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.959376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.959558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.960028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.960028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.961208] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.224152] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.224152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.224152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.224152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.228996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.228996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.228996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.228996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.228996] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.307984] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.308159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.308257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.308576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.308685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.308800] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddb9167-1b9c-4751-8cf3-4f83a593874e is going to be created. [ 665.338388] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.338590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.338672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.338846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.339022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.355086] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddb9167-1b9c-4751-8cf3-4f83a593874e in Status: UNINITIALIZED for 2s [ 665.463540] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.463832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.463832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.463988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.464125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.465024] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.465024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.465024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.465024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.465024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.465024] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db is going to be updated. [ 665.500804] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.500804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.501841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.501841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.501841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.514192] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: IN_PROGRESS for 2s [ 665.584199] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb in Status: SUCCESS [ 665.584374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.735610] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aec1e262-a46a-4ce5-b4f8-1392575d0891: rpc.has_security_group_logging(os_id): False [ 665.843032] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.843183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.843229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.843456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.843567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.843845] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.843949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.844027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.844208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.844291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.844494] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.844594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.844657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.844803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.844880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.846128] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.846128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.846128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.846128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.846128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.846128] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be created. [ 665.912781] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.912933] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.913087] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.913364] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.913702] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.913874] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.913928] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.914148] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.914289] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.914484] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.914584] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.914790] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.914790] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.914911] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.915049] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.915097] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.925229] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.925471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.925471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.925709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.925966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.940335] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.940335] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.940335] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.940335] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.940973] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.941287] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.941551] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.942068] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.942382] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab1f01f9-e3fa-4f15-b043-1fdaff97f857',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.945209] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 666.178601] env[65678]: INFO networking_nsxv3.common.synchronization [None req-44f0be2f-956a-4c6b-b0f2-9bc8f83cc969 None None] Enqueued Resource ID: 94d148be-217c-4c90-918c-311667369b5b with Priority: HIGHEST for action port [ 666.179233] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94d148be-217c-4c90-918c-311667369b5b with Priority: HIGHEST for action port [ 666.179599] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-94d148be-217c-4c90-918c-311667369b5b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.179753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94d148be-217c-4c90-918c-311667369b5b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.179820] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94d148be-217c-4c90-918c-311667369b5b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.180364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94d148be-217c-4c90-918c-311667369b5b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.180735] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94d148be-217c-4c90-918c-311667369b5b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.448792] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.448792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.448792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.448792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.448792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.448792] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port ab1f01f9-e3fa-4f15-b043-1fdaff97f857 not found, creating... [ 666.448792] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.448792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.448792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.448792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.448792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.449677] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.449677] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.449677] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.450125] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.450439] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.450693] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: ab1f01f9-e3fa-4f15-b043-1fdaff97f857 is going to be created. [ 666.475567] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.476473] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.476625] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.477740] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.477740] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.477740] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.683487] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94d148be-217c-4c90-918c-311667369b5b [ 666.683837] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.683992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.684104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.684358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.684485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.684596] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94d148be-217c-4c90-918c-311667369b5b already deleted. [ 666.684686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94d148be-217c-4c90-918c-311667369b5b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.216105] env[65678]: INFO networking_nsxv3.common.synchronization [req-a1f5169c-3b0f-4a14-bf3f-264f49327606 req-ef8c83e0-294e-4d50-8839-e04ad87677cd service nova] Enqueued Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_rules [ 667.216386] env[65678]: INFO networking_nsxv3.common.synchronization [req-a1f5169c-3b0f-4a14-bf3f-264f49327606 req-ef8c83e0-294e-4d50-8839-e04ad87677cd service nova] Enqueued Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 667.216483] env[65678]: INFO networking_nsxv3.common.synchronization [req-a1f5169c-3b0f-4a14-bf3f-264f49327606 req-ef8c83e0-294e-4d50-8839-e04ad87677cd service nova] Enqueued Resource ID: ab1f01f9-e3fa-4f15-b043-1fdaff97f857 with Priority: HIGHEST for action port [ 667.217030] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_rules [ 667.217181] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 667.217284] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab1f01f9-e3fa-4f15-b043-1fdaff97f857 with Priority: HIGHEST for action port [ 667.217587] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.218622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.219213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.219468] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.219556] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.220633] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.220633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.220815] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.220920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.220985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.222042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.222178] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab1f01f9-e3fa-4f15-b043-1fdaff97f857',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.368122] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddb9167-1b9c-4751-8cf3-4f83a593874e in Status: SUCCESS [ 667.368193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.369277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.369277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.369277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.369277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.369578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.369650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.369738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.369850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.370236] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cddb9167-1b9c-4751-8cf3-4f83a593874e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.527593] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: SUCCESS [ 667.527593] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db deletion is rescheduled due to dependency. [ 667.527593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.527593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.527808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.527859] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.528073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.528131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.528250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.528572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.528572] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.726044] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.726044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.726044] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab1f01f9-e3fa-4f15-b043-1fdaff97f857 with status ACTIVE [ 667.726485] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.726485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.726485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.726691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.726764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.726948] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.727065] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.727169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.727293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.727545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.727652] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.727725] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.727778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.727925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.728012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.728104] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab1f01f9-e3fa-4f15-b043-1fdaff97f857 is going to be updated. [ 667.760616] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.760616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.760616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.760616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.760900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.760952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab1f01f9-e3fa-4f15-b043-1fdaff97f857" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.874246] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddb9167-1b9c-4751-8cf3-4f83a593874e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.874665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.875381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.875945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.876171] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.876324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.876416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.876651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.876782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.877013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.877289] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddb9167-1b9c-4751-8cf3-4f83a593874e taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.877424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.877508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.877715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.877906] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.878249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.878368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.878572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.878679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.879103] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.879103] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cddb9167-1b9c-4751-8cf3-4f83a593874e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.963974] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 667.964469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.030905] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.136136] env[65678]: INFO networking_nsxv3.common.synchronization [req-1f242d36-dcc7-4bd5-a2f7-64b11bb3dffc req-62a52e00-cec6-446b-9a9f-09ef1feb129a tempest-TenantUsagesTestJSON-1995132264 tempest-TenantUsagesTestJSON-1995132264-project-member] Enqueued Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGHEST for action security_group_members [ 668.137285] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGHEST for action security_group_members [ 668.137285] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b98b8977-5505-4665-ad19-ac6d8455a014 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.137285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.137285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.137495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.139257] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.139257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.139257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.139257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.139257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.139257] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b98b8977-5505-4665-ad19-ac6d8455a014',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.381812] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cddb9167-1b9c-4751-8cf3-4f83a593874e: rpc.has_security_group_logging(os_id): False [ 668.401520] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.401520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.401520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.401520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.401520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.401838] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.401838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.401838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.401838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.402040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.402146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.402275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.402345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.402505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.402634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.402799] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.402886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.402952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.403183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.403269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.403357] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cddb9167-1b9c-4751-8cf3-4f83a593874e is going to be created. [ 668.441528] env[65678]: INFO networking_nsxv3.common.synchronization [None req-5e9ae435-d34d-46ce-a774-9c93cfeac34c None None] Enqueued Resource ID: 58e27d5f-d152-439f-8db0-4df57675021a with Priority: HIGHEST for action port [ 668.441528] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58e27d5f-d152-439f-8db0-4df57675021a with Priority: HIGHEST for action port [ 668.441528] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-58e27d5f-d152-439f-8db0-4df57675021a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.441528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58e27d5f-d152-439f-8db0-4df57675021a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.441528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58e27d5f-d152-439f-8db0-4df57675021a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.441988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58e27d5f-d152-439f-8db0-4df57675021a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.441988] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58e27d5f-d152-439f-8db0-4df57675021a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.465217] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.465217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.465399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.465596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.465806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.477512] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cddb9167-1b9c-4751-8cf3-4f83a593874e in Status: IN_PROGRESS for 2s [ 668.533646] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.610618] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.610911] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.611145] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.611471] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.611787] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.612018] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.612187] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.612452] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.612646] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.612939] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.613109] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.613225] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.613329] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.613436] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.613534] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.613664] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.643101] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.643101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.643101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.643101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.643409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.643409] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.643512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.643585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.643905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.644027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.644197] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b98b8977-5505-4665-ad19-ac6d8455a014 already deleted. [ 668.644270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.646765] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.646987] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.647179] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.647442] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.647892] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-fccb6df8-0d06-46bc-ba18-6a74161cda00 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.648166] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-fccb6df8-0d06-46bc-ba18-6a74161cda00" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.648344] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-fccb6df8-0d06-46bc-ba18-6a74161cda00" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.648607] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-fccb6df8-0d06-46bc-ba18-6a74161cda00" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.650286] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fccb6df8-0d06-46bc-ba18-6a74161cda00',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.944893] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58e27d5f-d152-439f-8db0-4df57675021a [ 668.945304] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.945496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.945599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.945936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.946098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.946251] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58e27d5f-d152-439f-8db0-4df57675021a already deleted. [ 668.946446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58e27d5f-d152-439f-8db0-4df57675021a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.036778] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.038140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.038280] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.038568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.038883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.039802] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db is going to be updated. [ 669.073061] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.073338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.073338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.073633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.073824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.085801] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: IN_PROGRESS for 2s [ 669.155870] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.156243] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.156390] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.156753] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.157027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.157185] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port fccb6df8-0d06-46bc-ba18-6a74161cda00 not found, creating... [ 669.157574] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.157798] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.157962] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.158321] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.158484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.158846] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.159088] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.159249] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.159544] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.159724] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.159909] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: fccb6df8-0d06-46bc-ba18-6a74161cda00 is going to be created. [ 669.189139] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.189466] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.189621] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.189977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.190235] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.190477] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-fccb6df8-0d06-46bc-ba18-6a74161cda00" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.906785] env[65678]: INFO networking_nsxv3.common.synchronization [req-1f242d36-dcc7-4bd5-a2f7-64b11bb3dffc req-c5fcbf01-3309-449e-beae-4b43cea37871 service nova] Enqueued Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGHEST for action security_group_rules [ 669.906785] env[65678]: INFO networking_nsxv3.common.synchronization [req-1f242d36-dcc7-4bd5-a2f7-64b11bb3dffc req-c5fcbf01-3309-449e-beae-4b43cea37871 service nova] Enqueued Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGHEST for action security_group_members [ 669.907191] env[65678]: INFO networking_nsxv3.common.synchronization [req-1f242d36-dcc7-4bd5-a2f7-64b11bb3dffc req-c5fcbf01-3309-449e-beae-4b43cea37871 service nova] Enqueued Resource ID: fccb6df8-0d06-46bc-ba18-6a74161cda00 with Priority: HIGHEST for action port [ 669.907561] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGHEST for action security_group_rules [ 669.907723] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGHEST for action security_group_members [ 669.907865] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fccb6df8-0d06-46bc-ba18-6a74161cda00 with Priority: HIGHEST for action port [ 669.908153] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b98b8977-5505-4665-ad19-ac6d8455a014 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.908288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.908546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.908623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.908720] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b98b8977-5505-4665-ad19-ac6d8455a014',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.910503] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b98b8977-5505-4665-ad19-ac6d8455a014 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.910631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.913375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.913375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.913375] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.913375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.913375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.913375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.913375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.913375] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b98b8977-5505-4665-ad19-ac6d8455a014',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.913375] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-fccb6df8-0d06-46bc-ba18-6a74161cda00 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.913375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fccb6df8-0d06-46bc-ba18-6a74161cda00" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.913375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fccb6df8-0d06-46bc-ba18-6a74161cda00" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.913375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fccb6df8-0d06-46bc-ba18-6a74161cda00" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.913375] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fccb6df8-0d06-46bc-ba18-6a74161cda00',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.305555] env[65678]: INFO networking_nsxv3.common.synchronization [req-f564eb9e-8d0c-4f6e-9916-ad32b0243545 req-35d4e3f1-838f-4958-a8dd-f380d4d52a54 tempest-ServerAddressesTestJSON-928152806 tempest-ServerAddressesTestJSON-928152806-project-member] Enqueued Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGHEST for action security_group_members [ 670.306104] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGHEST for action security_group_members [ 670.306438] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-c54cf5e6-150a-4668-bddb-ef25e038e5cf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.306568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.306639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.306836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.306983] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.307097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.307151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.307329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.307387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.307469] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c54cf5e6-150a-4668-bddb-ef25e038e5cf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.411565] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b98b8977-5505-4665-ad19-ac6d8455a014 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.411786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.417264] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b98b8977-5505-4665-ad19-ac6d8455a014',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.418393] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fccb6df8-0d06-46bc-ba18-6a74161cda00 with status ACTIVE [ 670.418500] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.418572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.418656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.418849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.418938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.419134] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.419256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.419313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.419472] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.419541] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.419717] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.419824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.419880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.421337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.421337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.421337] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fccb6df8-0d06-46bc-ba18-6a74161cda00 is going to be updated. [ 670.446277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.446427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.446509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.446756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.446842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.448088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fccb6df8-0d06-46bc-ba18-6a74161cda00" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.495058] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cddb9167-1b9c-4751-8cf3-4f83a593874e in Status: SUCCESS [ 670.495292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.811086] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.811255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.811325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.811563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.811806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.812030] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.812030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.812164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.812940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.812940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.812940] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf is going to be updated. [ 670.860427] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.860632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.860710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.860943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.861119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.875135] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf in Status: IN_PROGRESS for 2s [ 670.922835] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b98b8977-5505-4665-ad19-ac6d8455a014',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.100342] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: SUCCESS [ 671.100342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.100342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.100342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.100342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.100342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.100342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.101896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.101896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.101896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.101896] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.199011] env[65678]: INFO networking_nsxv3.common.synchronization [req-b29b0310-ee10-4928-a08f-472a536eeeb5 req-489a4c1c-bf19-471c-923b-7dfbbf62955c tempest-ListServerFiltersTestJSON-129772598 tempest-ListServerFiltersTestJSON-129772598-project-member] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 671.199655] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 671.200520] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.200520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.200769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.200817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.201201] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.201201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.201201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.201370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.201592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.201592] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.427515] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.427683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.427747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.427946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.428055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.428155] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b98b8977-5505-4665-ad19-ac6d8455a014 is going to be created. [ 671.457092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.457251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.457642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.457642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.457834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.471880] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b98b8977-5505-4665-ad19-ac6d8455a014 in Status: UNINITIALIZED for 2s [ 671.604121] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.605030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.608252] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.608252] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.608252] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.608252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.608925] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.705884] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.112230] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a4a38bf-eedc-4528-b75b-a6d281d9d8db: rpc.has_security_group_logging(os_id): False [ 672.133542] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.133688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.133779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.134085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.134209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.134454] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.134577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.134661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.135326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.135326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.135326] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.135326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.135326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.135595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.135595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.135871] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.135992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.136099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.140477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.140477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.140477] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db is going to be updated. [ 672.204809] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-726 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.205291] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.205291] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.205679] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.206141] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.206483] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.206686] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.207059] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.207317] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.207651] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.207802] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.207927] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.208208] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.208389] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.208520] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.208686] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.211352] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.230740] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.230740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.230740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.230740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.230740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.235654] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.235946] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.236185] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.236463] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.236892] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-70a53f97-83b0-455a-9a97-222a1c036786 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.237176] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-70a53f97-83b0-455a-9a97-222a1c036786" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.237377] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-70a53f97-83b0-455a-9a97-222a1c036786" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.237828] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-70a53f97-83b0-455a-9a97-222a1c036786" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.238070] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70a53f97-83b0-455a-9a97-222a1c036786',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.249562] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: IN_PROGRESS for 2s [ 672.463285] env[65678]: INFO networking_nsxv3.common.synchronization [None req-0405c779-5808-49c2-bb25-a129798f81fa None None] Enqueued Resource ID: 6f6aa49d-2151-44f3-926d-7c15f0d17f29 with Priority: HIGHEST for action port [ 672.463285] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f6aa49d-2151-44f3-926d-7c15f0d17f29 with Priority: HIGHEST for action port [ 672.464102] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f6aa49d-2151-44f3-926d-7c15f0d17f29 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.464499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f6aa49d-2151-44f3-926d-7c15f0d17f29" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.464683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f6aa49d-2151-44f3-926d-7c15f0d17f29" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.466408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f6aa49d-2151-44f3-926d-7c15f0d17f29" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.466408] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f6aa49d-2151-44f3-926d-7c15f0d17f29',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.714121] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.714121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.714121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.714121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.714121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.714519] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be updated. [ 672.740977] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.741241] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.741376] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.741656] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.741803] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.741955] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 70a53f97-83b0-455a-9a97-222a1c036786 not found, creating... [ 672.742244] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.742400] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.742513] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.742766] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.742909] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.743204] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.743357] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.743469] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.743681] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.743806] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.743998] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 70a53f97-83b0-455a-9a97-222a1c036786 is going to be created. [ 672.746192] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.746307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.746367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.746531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.746676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.757803] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 672.767359] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.767566] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.767755] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.768101] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.768332] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.768554] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-70a53f97-83b0-455a-9a97-222a1c036786" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.887713] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf in Status: SUCCESS [ 672.887929] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf deletion is rescheduled due to dependency. [ 672.888079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.920129] env[65678]: INFO networking_nsxv3.common.synchronization [None req-9be34463-f291-4143-83d3-99af02e4d9f5 None None] Enqueued Resource ID: 82e2e05c-4f40-4b0f-91ec-5e4634a8a230 with Priority: HIGHEST for action port [ 672.921405] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e2e05c-4f40-4b0f-91ec-5e4634a8a230 with Priority: HIGHEST for action port [ 672.921405] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-82e2e05c-4f40-4b0f-91ec-5e4634a8a230 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.923446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82e2e05c-4f40-4b0f-91ec-5e4634a8a230" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.923446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82e2e05c-4f40-4b0f-91ec-5e4634a8a230" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.923446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82e2e05c-4f40-4b0f-91ec-5e4634a8a230" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.923446] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e2e05c-4f40-4b0f-91ec-5e4634a8a230',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.967562] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f6aa49d-2151-44f3-926d-7c15f0d17f29 [ 672.967809] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.967949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.968029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.968341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.968437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.968542] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f6aa49d-2151-44f3-926d-7c15f0d17f29 already deleted. [ 672.968611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f6aa49d-2151-44f3-926d-7c15f0d17f29" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.427110] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82e2e05c-4f40-4b0f-91ec-5e4634a8a230 [ 673.427398] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.427509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.427570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.428097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.428097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.428097] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82e2e05c-4f40-4b0f-91ec-5e4634a8a230 already deleted. [ 673.428097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82e2e05c-4f40-4b0f-91ec-5e4634a8a230" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.483099] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b98b8977-5505-4665-ad19-ac6d8455a014 in Status: SUCCESS [ 673.484652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.484954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.485260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.485478] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.485611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.485679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.485882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.486231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.486231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.486231] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b98b8977-5505-4665-ad19-ac6d8455a014',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.510129] env[65678]: INFO networking_nsxv3.common.synchronization [req-b29b0310-ee10-4928-a08f-472a536eeeb5 req-a9ddd476-30ee-4fca-a494-6c3b4f62ed14 service nova] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_rules [ 673.510305] env[65678]: INFO networking_nsxv3.common.synchronization [req-b29b0310-ee10-4928-a08f-472a536eeeb5 req-a9ddd476-30ee-4fca-a494-6c3b4f62ed14 service nova] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 673.510432] env[65678]: INFO networking_nsxv3.common.synchronization [req-b29b0310-ee10-4928-a08f-472a536eeeb5 req-a9ddd476-30ee-4fca-a494-6c3b4f62ed14 service nova] Enqueued Resource ID: 70a53f97-83b0-455a-9a97-222a1c036786 with Priority: HIGHEST for action port [ 673.510650] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_rules [ 673.510778] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 673.510871] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70a53f97-83b0-455a-9a97-222a1c036786 with Priority: HIGHEST for action port [ 673.511406] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.511537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.511604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.511943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.511943] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.512724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.512813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.513339] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-70a53f97-83b0-455a-9a97-222a1c036786 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.513485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70a53f97-83b0-455a-9a97-222a1c036786" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.513568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70a53f97-83b0-455a-9a97-222a1c036786" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.513746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70a53f97-83b0-455a-9a97-222a1c036786" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.513835] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70a53f97-83b0-455a-9a97-222a1c036786',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.990066] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b98b8977-5505-4665-ad19-ac6d8455a014 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.990066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.990066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.990553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.990553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.990553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.990553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.990997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.991122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.991282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.991511] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b98b8977-5505-4665-ad19-ac6d8455a014 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.991664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.991799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.991954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.992287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.992287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.992380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.992541] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.992661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.992821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.992941] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b98b8977-5505-4665-ad19-ac6d8455a014',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.019945] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70a53f97-83b0-455a-9a97-222a1c036786 with status ACTIVE [ 674.019945] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.019945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.019945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.020238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.020238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.020896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.020896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.020896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.020896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.020896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.021310] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.021310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.021310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.021310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.021310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.021516] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70a53f97-83b0-455a-9a97-222a1c036786 is going to be updated. [ 674.022684] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.022840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.047084] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.047351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.047351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.047593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.047762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.047909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70a53f97-83b0-455a-9a97-222a1c036786" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.281079] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: SUCCESS [ 674.282137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.495911] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b98b8977-5505-4665-ad19-ac6d8455a014: rpc.has_security_group_logging(os_id): False [ 674.520991] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.521090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.521178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.521377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.521480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.521783] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.521847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.522287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.522638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.522638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.524329] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.525161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.525238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.525420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.525541] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.525750] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.525854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.525915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.526078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.526155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.526243] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b98b8977-5505-4665-ad19-ac6d8455a014 is going to be created. [ 674.617674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.617897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.617956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.618590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.618590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.634798] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b98b8977-5505-4665-ad19-ac6d8455a014 in Status: IN_PROGRESS for 2s [ 674.698422] env[65678]: INFO networking_nsxv3.common.synchronization [None req-724eb9df-72b8-4806-813e-c7db63a65891 None None] Enqueued Resource ID: 6d1fd7e3-b70a-458b-b88a-679a119bd97c with Priority: HIGHEST for action port [ 674.698422] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d1fd7e3-b70a-458b-b88a-679a119bd97c with Priority: HIGHEST for action port [ 674.698422] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d1fd7e3-b70a-458b-b88a-679a119bd97c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.698422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d1fd7e3-b70a-458b-b88a-679a119bd97c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.698422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d1fd7e3-b70a-458b-b88a-679a119bd97c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.698422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d1fd7e3-b70a-458b-b88a-679a119bd97c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.698422] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d1fd7e3-b70a-458b-b88a-679a119bd97c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.772347] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 674.772347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.772347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.772617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.772617] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.772790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.772909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.773058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.773154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.773250] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.886182] env[65678]: INFO networking_nsxv3.common.synchronization [req-ec6d1541-e1a4-4cc6-a918-d4dc8840423a req-07438047-9b85-430d-9918-6abbd0df47b3 tempest-AttachInterfacesV270Test-929008870 tempest-AttachInterfacesV270Test-929008870-project-member] Enqueued Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGHEST for action security_group_members [ 674.886499] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGHEST for action security_group_members [ 674.886884] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8085af0-0afc-45eb-a26a-73aa0c8599a4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.887063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.887180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.887659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.887890] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.888421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.888974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.889264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.889406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.889519] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8085af0-0afc-45eb-a26a-73aa0c8599a4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.202041] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d1fd7e3-b70a-458b-b88a-679a119bd97c [ 675.202041] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.202041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.202041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.202041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.202041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.202041] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d1fd7e3-b70a-458b-b88a-679a119bd97c already deleted. [ 675.202041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d1fd7e3-b70a-458b-b88a-679a119bd97c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.243437] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.243858] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-683" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.244045] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-683" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.244385] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-683" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.245058] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.245271] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.245425] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.246043] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.246043] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.246043] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.246280] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.246406] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.247042] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.247042] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.247042] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.247042] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.270084] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.270257] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.270419] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.270646] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-683" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.270906] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-12bdd52b-1980-4bd2-873f-1267717d772c taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.271113] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-12bdd52b-1980-4bd2-873f-1267717d772c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.271235] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-12bdd52b-1980-4bd2-873f-1267717d772c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.271559] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-12bdd52b-1980-4bd2-873f-1267717d772c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.271697] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12bdd52b-1980-4bd2-873f-1267717d772c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.278371] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.396414] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.396600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.396676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.396909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.397017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.397360] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.397360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.397360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.397540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.397576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.397659] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 already deleted. [ 675.397739] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.777629] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.778083] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.778083] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.778274] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.778445] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.778717] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 12bdd52b-1980-4bd2-873f-1267717d772c not found, creating... [ 675.780413] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.780618] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.780676] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.780891] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.781044] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.781343] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.781521] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.781637] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.781857] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.781991] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.783590] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 12bdd52b-1980-4bd2-873f-1267717d772c is going to be created. [ 675.785396] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.810687] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.810934] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.810934] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.811323] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.811628] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.812122] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-12bdd52b-1980-4bd2-873f-1267717d772c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.821867] env[65678]: INFO networking_nsxv3.common.synchronization [None req-f52ee404-3669-470c-be74-8cc8d11bc6ec None None] Enqueued Resource ID: e44f7677-4838-49bb-af76-c6bea175e691 with Priority: HIGHEST for action port [ 675.822560] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e44f7677-4838-49bb-af76-c6bea175e691 with Priority: HIGHEST for action port [ 675.822921] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-e44f7677-4838-49bb-af76-c6bea175e691 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.826035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e44f7677-4838-49bb-af76-c6bea175e691" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.826035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e44f7677-4838-49bb-af76-c6bea175e691" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.826035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e44f7677-4838-49bb-af76-c6bea175e691" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.826035] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e44f7677-4838-49bb-af76-c6bea175e691',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.288144] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.288355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.288355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.288593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.288682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.288972] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be updated. [ 676.318889] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.319047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.319110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.319341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.319486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.326524] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e44f7677-4838-49bb-af76-c6bea175e691 [ 676.326732] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.326732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.326911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.326969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.327058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.327361] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e44f7677-4838-49bb-af76-c6bea175e691 already deleted. [ 676.327361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e44f7677-4838-49bb-af76-c6bea175e691" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.333051] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 676.531294] env[65678]: INFO networking_nsxv3.common.synchronization [req-ec6d1541-e1a4-4cc6-a918-d4dc8840423a req-352965c7-3803-4ab3-9d26-ce9a22079299 service nova] Enqueued Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGHEST for action security_group_rules [ 676.531294] env[65678]: INFO networking_nsxv3.common.synchronization [req-ec6d1541-e1a4-4cc6-a918-d4dc8840423a req-352965c7-3803-4ab3-9d26-ce9a22079299 service nova] Enqueued Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGHEST for action security_group_members [ 676.533911] env[65678]: INFO networking_nsxv3.common.synchronization [req-ec6d1541-e1a4-4cc6-a918-d4dc8840423a req-352965c7-3803-4ab3-9d26-ce9a22079299 service nova] Enqueued Resource ID: 12bdd52b-1980-4bd2-873f-1267717d772c with Priority: HIGHEST for action port [ 676.534986] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGHEST for action security_group_rules [ 676.535319] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGHEST for action security_group_members [ 676.535710] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12bdd52b-1980-4bd2-873f-1267717d772c with Priority: HIGHEST for action port [ 676.536299] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.536784] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.537032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.537478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.537744] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8085af0-0afc-45eb-a26a-73aa0c8599a4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.539460] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8085af0-0afc-45eb-a26a-73aa0c8599a4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.540143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.542141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.542141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.542141] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.542141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.542141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.548452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.548452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.548452] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8085af0-0afc-45eb-a26a-73aa0c8599a4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.548452] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-12bdd52b-1980-4bd2-873f-1267717d772c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.548452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12bdd52b-1980-4bd2-873f-1267717d772c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.548452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12bdd52b-1980-4bd2-873f-1267717d772c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.548452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12bdd52b-1980-4bd2-873f-1267717d772c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.548452] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12bdd52b-1980-4bd2-873f-1267717d772c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.654096] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b98b8977-5505-4665-ad19-ac6d8455a014 in Status: SUCCESS [ 676.654567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.051343] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8085af0-0afc-45eb-a26a-73aa0c8599a4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.052699] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8085af0-0afc-45eb-a26a-73aa0c8599a4 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.054445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.055153] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12bdd52b-1980-4bd2-873f-1267717d772c with status ACTIVE [ 677.055153] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.055153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.055153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.055461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.055461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.055671] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.060543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.060668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.061066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.061115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.061413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.061580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.061649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.061891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.061988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.062195] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12bdd52b-1980-4bd2-873f-1267717d772c is going to be updated. [ 677.088648] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.088895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.089429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.089429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.090213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.090213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12bdd52b-1980-4bd2-873f-1267717d772c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.285336] env[65678]: INFO networking_nsxv3.common.synchronization [req-e55e6a49-097d-46a9-bf2f-1ad430e2b285 req-f24f6135-f0ef-4d1f-92c7-b39036818938 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 677.285938] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 677.286417] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.286812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.286812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.287286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.287286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.287556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.287619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.287846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.288112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.288112] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.564974] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8085af0-0afc-45eb-a26a-73aa0c8599a4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.771429] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.771659] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-134" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.771952] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-134" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.772342] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-134" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.772636] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.772898] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.773047] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.773373] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.773915] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.773915] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.774092] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.774209] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.774384] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.775016] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.775016] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.775016] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.792149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.792149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.792149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.792149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.792149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.792149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.792149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.792149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.792149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.792149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.792149] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 already deleted. [ 677.792149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.800603] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.801635] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 677.801635] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.801635] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-134" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.803023] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-b38c7b49-b436-4943-8213-9356eccb8997 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.803023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.803023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.803023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.803795] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38c7b49-b436-4943-8213-9356eccb8997',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.068744] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.069044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.069044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.070666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.070666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.070666] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 is going to be created. [ 678.096740] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.096944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.097017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.097215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.097706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.108147] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 in Status: UNINITIALIZED for 2s [ 678.307838] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.308136] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.308251] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.308551] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.308700] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.308860] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port b38c7b49-b436-4943-8213-9356eccb8997 not found, creating... [ 678.309169] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.309337] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.309453] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.309693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.309830] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.310146] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.310353] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.310570] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.310897] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.311090] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.311299] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: b38c7b49-b436-4943-8213-9356eccb8997 is going to be created. [ 678.336369] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.336666] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.336666] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.336989] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.337928] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.338557] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.355032] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 678.355363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.355563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.355865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.356128] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.356274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.356731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.356731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.356731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.356933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.356933] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.862656] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.862656] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.862656] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.862656] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.862656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.864126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.864126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.864126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.864126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.864126] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.101609] env[65678]: INFO networking_nsxv3.common.synchronization [req-e55e6a49-097d-46a9-bf2f-1ad430e2b285 req-819083ba-ab26-446b-968f-49ac751bc253 service nova] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 679.101609] env[65678]: INFO networking_nsxv3.common.synchronization [req-e55e6a49-097d-46a9-bf2f-1ad430e2b285 req-819083ba-ab26-446b-968f-49ac751bc253 service nova] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 679.101609] env[65678]: INFO networking_nsxv3.common.synchronization [req-e55e6a49-097d-46a9-bf2f-1ad430e2b285 req-819083ba-ab26-446b-968f-49ac751bc253 service nova] Enqueued Resource ID: b38c7b49-b436-4943-8213-9356eccb8997 with Priority: HIGHEST for action port [ 679.101609] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 679.101609] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 679.101609] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b38c7b49-b436-4943-8213-9356eccb8997 with Priority: HIGHEST for action port [ 679.101609] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.101609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.102240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.102240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.102240] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.103180] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.103303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.103350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.103684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.103684] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.103892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.103892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.103974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.104156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.104373] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.105542] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b38c7b49-b436-4943-8213-9356eccb8997 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.105542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.105542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.106018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.106018] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38c7b49-b436-4943-8213-9356eccb8997',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.367986] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aec1e262-a46a-4ce5-b4f8-1392575d0891: rpc.has_security_group_logging(os_id): False [ 679.385080] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.385080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.385080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.385420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.385564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.387019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.387019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.387019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.387019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.387019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.387019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.387019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.387019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.387019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.387019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.387489] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.387489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.387489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.387664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.387783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.387900] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be updated. [ 679.461445] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.461445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.461445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.461445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.461445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.474979] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 679.608878] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.611869] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.611869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.611869] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b38c7b49-b436-4943-8213-9356eccb8997 with status ACTIVE [ 679.611869] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.611869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.611869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.613598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.614232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.614232] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.614509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.614509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.615352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.615352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.615352] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.615352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.616271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.616271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.616271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.616271] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b38c7b49-b436-4943-8213-9356eccb8997 is going to be updated. [ 679.639182] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.639369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.639460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.639677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.640352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.640352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.086967] env[65678]: INFO networking_nsxv3.common.synchronization [req-b6e35b51-8da6-422e-b381-c75e2f102fcc req-043de21d-0a71-4cb2-93d7-84710f00de5f tempest-ListServerFiltersTestJSON-129772598 tempest-ListServerFiltersTestJSON-129772598-project-member] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 680.086967] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 680.088992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.089234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.089348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.089605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.089779] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.089892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.089951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.090155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.090232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.090283] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.118948] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.121868] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 in Status: SUCCESS [ 680.122088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.125173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.125173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.125173] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.125173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.125173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.125173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.125173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.125173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.125173] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8085af0-0afc-45eb-a26a-73aa0c8599a4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.504670] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-726 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.504984] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.505192] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.505636] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.506127] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.506288] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.506463] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.506728] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.506923] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.507253] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.507452] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.507579] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.507773] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.508043] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.508231] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.508461] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.533977] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.533977] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.533977] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.533977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-726" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.533977] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-c9844632-1b09-4ad3-9e40-d7d322af03fe taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.533977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-c9844632-1b09-4ad3-9e40-d7d322af03fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.533977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-c9844632-1b09-4ad3-9e40-d7d322af03fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.534600] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-c9844632-1b09-4ad3-9e40-d7d322af03fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.534600] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9844632-1b09-4ad3-9e40-d7d322af03fe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.593328] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.627804] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.628023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.628023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.628230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.628342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.628654] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be created. [ 680.630285] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8085af0-0afc-45eb-a26a-73aa0c8599a4 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.630441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.630492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.631033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.631033] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.631210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.631210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.631369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.631461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.631573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.631748] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8085af0-0afc-45eb-a26a-73aa0c8599a4 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.631865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.631948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.632136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.632308] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.632405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.632485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.632664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.632799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.632888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.632984] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8085af0-0afc-45eb-a26a-73aa0c8599a4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.661892] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.662147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.662218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.662491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.662953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.674080] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: UNINITIALIZED for 2s [ 681.037278] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.037563] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.037742] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.038070] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.038243] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.038399] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port c9844632-1b09-4ad3-9e40-d7d322af03fe not found, creating... [ 681.038678] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.038833] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.038972] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.039269] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.039433] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.039799] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.039962] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.040095] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.040341] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.040487] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.040631] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: c9844632-1b09-4ad3-9e40-d7d322af03fe is going to be created. [ 681.063559] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.063857] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.063933] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.064189] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.064412] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.064633] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-c9844632-1b09-4ad3-9e40-d7d322af03fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.096972] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.135692] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8085af0-0afc-45eb-a26a-73aa0c8599a4: rpc.has_security_group_logging(os_id): False [ 681.153376] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.153548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.153612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.153845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.153949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.155560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.155560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.155560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.155560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.156231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.156231] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 is going to be created. [ 681.232356] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.232470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.232535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.232824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.233068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.254692] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 in Status: IN_PROGRESS for 2s [ 681.490822] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 681.491120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.599886] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.600907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.600907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.600907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.600907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.600907] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be updated. [ 681.636782] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.636983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.637072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.637236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.637376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.648381] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 681.869685] env[65678]: INFO networking_nsxv3.common.synchronization [req-b6e35b51-8da6-422e-b381-c75e2f102fcc req-5686fb1e-c854-4839-8edf-51fb5a42418f service nova] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_rules [ 681.869887] env[65678]: INFO networking_nsxv3.common.synchronization [req-b6e35b51-8da6-422e-b381-c75e2f102fcc req-5686fb1e-c854-4839-8edf-51fb5a42418f service nova] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 681.870043] env[65678]: INFO networking_nsxv3.common.synchronization [req-b6e35b51-8da6-422e-b381-c75e2f102fcc req-5686fb1e-c854-4839-8edf-51fb5a42418f service nova] Enqueued Resource ID: c9844632-1b09-4ad3-9e40-d7d322af03fe with Priority: HIGHEST for action port [ 681.870676] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_rules [ 681.870814] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 681.870909] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9844632-1b09-4ad3-9e40-d7d322af03fe with Priority: HIGHEST for action port [ 681.871536] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.871678] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.871768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.871992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.872141] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.873858] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.874106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.874349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9844632-1b09-4ad3-9e40-d7d322af03fe taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.874435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9844632-1b09-4ad3-9e40-d7d322af03fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.874481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9844632-1b09-4ad3-9e40-d7d322af03fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.878032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9844632-1b09-4ad3-9e40-d7d322af03fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.878032] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9844632-1b09-4ad3-9e40-d7d322af03fe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.375737] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.375737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.376870] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9844632-1b09-4ad3-9e40-d7d322af03fe with status ACTIVE [ 682.377095] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.377225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.377294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.378643] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.378643] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.378643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.379398] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9844632-1b09-4ad3-9e40-d7d322af03fe is going to be updated. [ 682.402954] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.405115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.405312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.405486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.405705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.405959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9844632-1b09-4ad3-9e40-d7d322af03fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.688026] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 682.689371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.689838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.691498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.691498] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.691498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.691498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.691498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.691498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.692966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.693147] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.199026] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.199026] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.199026] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.199026] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.199026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.199907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.199907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.199907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.199907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.199907] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.279369] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 in Status: SUCCESS [ 683.279591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.578102] env[65678]: INFO networking_nsxv3.common.synchronization [req-0a9315bc-cc25-47b6-a4ee-f06d6699a2d6 req-4d6ffc0f-3072-423a-8eab-f1fd2df5eecb tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 683.578102] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 683.578102] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.578708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.578708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.578708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.578708] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.578897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.578897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.579050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.579098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.579358] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.662334] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 683.662478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.662652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.662920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.663190] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.663364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.663442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.663556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.663663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.663779] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.702741] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393a6f14-3ce6-441b-a403-1993c47b58e3: rpc.has_security_group_logging(os_id): False [ 683.722674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.723045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.723154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.723385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.723494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.723775] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.723911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.723987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.724179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.724253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.724443] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.724538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.724595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.724740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.724814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.725056] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.725140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.725183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.725654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.725776] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.725885] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be created. [ 683.789162] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.789421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.789497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.789795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.790032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.802660] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 684.082837] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.083047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.083099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.083570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.083675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.083940] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.084042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.084105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.084475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.084621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.084716] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 already deleted. [ 684.084828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.120111] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.120111] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.120111] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.120111] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.120111] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.120111] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.120111] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.121179] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.121355] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.122269] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.122269] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.122269] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.122269] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.122269] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.122269] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.122749] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.142951] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.143117] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.143247] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.143417] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.143752] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-021bdecc-83a7-4c28-af05-e6cca2098e28 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.143915] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-021bdecc-83a7-4c28-af05-e6cca2098e28" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.144016] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-021bdecc-83a7-4c28-af05-e6cca2098e28" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.144363] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-021bdecc-83a7-4c28-af05-e6cca2098e28" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.144490] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('021bdecc-83a7-4c28-af05-e6cca2098e28',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.168580] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.599235] env[65678]: INFO networking_nsxv3.common.synchronization [req-9ee66330-5ec9-4fa6-865c-b2ed42eaf8bf req-58947111-4a68-412a-9971-bc20c7018337 tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 684.600149] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 684.600149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.600409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.600409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.600516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.601117] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.601117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.601117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.601117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.601117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.601392] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.647564] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.647803] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.648038] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.648573] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.648573] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.648573] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 021bdecc-83a7-4c28-af05-e6cca2098e28 not found, creating... [ 684.649245] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.649245] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.649245] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.658929] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.658929] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.658929] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.658929] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.658929] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.658929] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.658929] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.658929] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 021bdecc-83a7-4c28-af05-e6cca2098e28 is going to be created. [ 684.669893] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.682900] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.683349] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.683575] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.683999] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.684645] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.685082] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-021bdecc-83a7-4c28-af05-e6cca2098e28" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.106034] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.106034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.106034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.106034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.106034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.106034] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.106034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.106034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.106034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.106034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.106034] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 685.139818] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.139818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.139818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.140121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.140121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.151478] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 685.173897] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.174286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.174286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.174506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.174656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.174832] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be updated. [ 685.225150] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.225398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.225529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.225861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.226113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.248114] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 685.433217] env[65678]: INFO networking_nsxv3.common.synchronization [req-22f93f8d-a0dc-4759-97bc-d9fd0e7c24a6 req-4565d491-377a-4695-9654-dbdd1b9bd4c4 tempest-ServerExternalEventsTest-797176871 tempest-ServerExternalEventsTest-797176871-project-member] Enqueued Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGHEST for action security_group_members [ 685.433817] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGHEST for action security_group_members [ 685.434424] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46c3f3e-0eeb-4c56-8053-6f8baff61565 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.434579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.434647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.435008] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.435480] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.435891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.435891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.436051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.436051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.436121] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46c3f3e-0eeb-4c56-8053-6f8baff61565',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.481411] env[65678]: INFO networking_nsxv3.common.synchronization [req-0a9315bc-cc25-47b6-a4ee-f06d6699a2d6 req-c96e75c1-4103-406f-8f18-d9895e487aac service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 685.481699] env[65678]: INFO networking_nsxv3.common.synchronization [req-0a9315bc-cc25-47b6-a4ee-f06d6699a2d6 req-c96e75c1-4103-406f-8f18-d9895e487aac service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 685.481914] env[65678]: INFO networking_nsxv3.common.synchronization [req-0a9315bc-cc25-47b6-a4ee-f06d6699a2d6 req-c96e75c1-4103-406f-8f18-d9895e487aac service nova] Enqueued Resource ID: 021bdecc-83a7-4c28-af05-e6cca2098e28 with Priority: HIGHEST for action port [ 685.483944] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 685.484123] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 685.484227] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 021bdecc-83a7-4c28-af05-e6cca2098e28 with Priority: HIGHEST for action port [ 685.484911] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.484911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.484911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.485239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.485239] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.486110] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.486110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.486253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.486357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.486468] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.486561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.486622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.486758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.486845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.486936] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.488271] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-021bdecc-83a7-4c28-af05-e6cca2098e28 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.488271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-021bdecc-83a7-4c28-af05-e6cca2098e28" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.488271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-021bdecc-83a7-4c28-af05-e6cca2098e28" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.488546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-021bdecc-83a7-4c28-af05-e6cca2098e28" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.488546] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('021bdecc-83a7-4c28-af05-e6cca2098e28',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.824491] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 685.824863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.901659] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.901659] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.901659] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.901659] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.902106] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.902106] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.902106] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.902232] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.902350] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.902563] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.902673] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.902888] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.903058] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.903186] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.903766] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.903766] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.929360] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.929606] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.929773] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.930543] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.930543] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.930879] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.930879] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.931225] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.931451] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d4ceac0-19fb-4c02-83eb-1f8963cf26b6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.939033] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.939253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.939330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.939587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.939697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.940054] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.940165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.940165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.940359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.940467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.940585] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 already deleted. [ 685.940724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.991701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.991937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992269] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.993463] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 021bdecc-83a7-4c28-af05-e6cca2098e28 with status ACTIVE [ 685.994164] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.994164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.994164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.994391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.994391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.996587] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.996758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.996845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.997085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.997202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.997599] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.997681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.997755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.997944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.998071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.998209] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 021bdecc-83a7-4c28-af05-e6cca2098e28 is going to be updated. [ 686.026146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.026326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.026397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.026708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.026947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.027113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-021bdecc-83a7-4c28-af05-e6cca2098e28" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.434315] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.434566] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.434566] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.434877] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.435152] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.435251] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 5d4ceac0-19fb-4c02-83eb-1f8963cf26b6 not found, creating... [ 686.435557] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.435738] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.435918] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.436206] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.436357] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.436728] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.436907] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.437056] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.437295] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.437449] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.437606] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 5d4ceac0-19fb-4c02-83eb-1f8963cf26b6 is going to be created. [ 686.463772] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.463995] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.464136] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.464423] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.464665] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.464891] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.501279] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.004304] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.004304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.004304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.004304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.004854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.004854] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be created. [ 687.040583] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.040908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.040989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.041210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.041366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.054914] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: UNINITIALIZED for 2s [ 687.162573] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 687.162823] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d deletion is rescheduled due to dependency. [ 687.162938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.180478] env[65678]: INFO networking_nsxv3.common.synchronization [req-22f93f8d-a0dc-4759-97bc-d9fd0e7c24a6 req-03606ae5-1fe2-4779-84e0-82de80cca93a service nova] Enqueued Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGHEST for action security_group_rules [ 687.180658] env[65678]: INFO networking_nsxv3.common.synchronization [req-22f93f8d-a0dc-4759-97bc-d9fd0e7c24a6 req-03606ae5-1fe2-4779-84e0-82de80cca93a service nova] Enqueued Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGHEST for action security_group_members [ 687.180797] env[65678]: INFO networking_nsxv3.common.synchronization [req-22f93f8d-a0dc-4759-97bc-d9fd0e7c24a6 req-03606ae5-1fe2-4779-84e0-82de80cca93a service nova] Enqueued Resource ID: 5d4ceac0-19fb-4c02-83eb-1f8963cf26b6 with Priority: HIGHEST for action port [ 687.181348] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGHEST for action security_group_rules [ 687.181486] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGHEST for action security_group_members [ 687.181581] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d4ceac0-19fb-4c02-83eb-1f8963cf26b6 with Priority: HIGHEST for action port [ 687.181868] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.182046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.182046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.182517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.182517] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f46c3f3e-0eeb-4c56-8053-6f8baff61565',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.183270] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46c3f3e-0eeb-4c56-8053-6f8baff61565 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.183491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.183491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.183644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.183811] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.183910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.183968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.184171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.184235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.184289] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46c3f3e-0eeb-4c56-8053-6f8baff61565',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.185189] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.185352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.185392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.185701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.185701] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d4ceac0-19fb-4c02-83eb-1f8963cf26b6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.264025] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 687.264630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.264630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.264783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.264974] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.265278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.265401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.265659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.265793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.265947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.266339] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.688150] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46c3f3e-0eeb-4c56-8053-6f8baff61565 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.688332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.688500] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f46c3f3e-0eeb-4c56-8053-6f8baff61565',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.692816] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d4ceac0-19fb-4c02-83eb-1f8963cf26b6 with status ACTIVE [ 687.692921] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.693066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.693132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.693353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.693442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.693615] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.693736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.693796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.693948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.693994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.694323] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.694420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.694463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.694915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.694915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.694915] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d4ceac0-19fb-4c02-83eb-1f8963cf26b6 is going to be updated. [ 687.721107] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.721316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.721316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.721528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.721662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.721933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d4ceac0-19fb-4c02-83eb-1f8963cf26b6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.768698] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.768937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.768937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.769161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.769336] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.769439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.769503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.769661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.769903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.769903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.770041] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.770111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.770189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.770332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.770467] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.770612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.770692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.770860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.770949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.771055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.771150] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.198186] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f46c3f3e-0eeb-4c56-8053-6f8baff61565',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.274305] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aec1e262-a46a-4ce5-b4f8-1392575d0891: rpc.has_security_group_logging(os_id): False [ 688.296315] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.296548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.296548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.296741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.296842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.297023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.297114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.297168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.297327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.297430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.297596] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.297709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.297776] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.297865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.297933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.298140] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.298277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.298277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.298422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.298519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.298604] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be updated. [ 688.354697] env[65678]: INFO networking_nsxv3.common.synchronization [None req-ca9c19a5-c5eb-467c-9bb4-d522e24e0fa1 None None] Enqueued Resource ID: c05b68cd-aa9c-4987-b2c9-a53e35e90514 with Priority: HIGHEST for action port [ 688.360321] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c05b68cd-aa9c-4987-b2c9-a53e35e90514 with Priority: HIGHEST for action port [ 688.361024] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c05b68cd-aa9c-4987-b2c9-a53e35e90514 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.361184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c05b68cd-aa9c-4987-b2c9-a53e35e90514" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.361287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c05b68cd-aa9c-4987-b2c9-a53e35e90514" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.361654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c05b68cd-aa9c-4987-b2c9-a53e35e90514" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.361936] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c05b68cd-aa9c-4987-b2c9-a53e35e90514',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.414419] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.414653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.414653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.414925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.414989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.434123] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 688.700760] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.701043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.701179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.701420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.701596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.701790] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 is going to be created. [ 688.738684] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.738925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.739043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.739368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.739595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.754601] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 in Status: UNINITIALIZED for 2s [ 688.864440] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c05b68cd-aa9c-4987-b2c9-a53e35e90514 [ 688.864815] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.864946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.864946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.865248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.865351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.865468] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c05b68cd-aa9c-4987-b2c9-a53e35e90514 already deleted. [ 688.865554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c05b68cd-aa9c-4987-b2c9-a53e35e90514" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.068078] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 689.068270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.068454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.068726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.068955] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.069237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.069237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.069440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.069793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.069793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.069793] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.582946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.582946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.582946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.582946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.582946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.584100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.584100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.584100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.584100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.584100] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.916501] env[65678]: INFO networking_nsxv3.common.synchronization [req-28a1db20-dd19-468a-9cf7-240379e9fbda req-281f35c1-83f1-486f-ab35-4914caccc046 tempest-FloatingIPsAssociationTestJSON-1218227649 tempest-FloatingIPsAssociationTestJSON-1218227649-project-member] Enqueued Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 689.917319] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 689.918964] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.918964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.918964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.918964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.918964] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.918964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.918964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.919469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.919469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.919469] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.089277] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02e933d1-ac0d-4baa-9da0-e149762ce926: rpc.has_security_group_logging(os_id): False [ 690.113955] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.114129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.114182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.114391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.114478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.114750] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.114857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.114904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.115059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.115137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.115317] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.115465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.115465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.115582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.115674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.115824] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.116080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.116149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.116872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.116872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.116872] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be created. [ 690.227944] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.228285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.228285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.228543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.228872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.242802] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 690.421502] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.458568] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 690.458810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.769102] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 in Status: SUCCESS [ 690.769555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.769555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.769555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.769950] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.769950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.769950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.770166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.770166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.770243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.770284] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f46c3f3e-0eeb-4c56-8053-6f8baff61565',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.926043] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.272779] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46c3f3e-0eeb-4c56-8053-6f8baff61565 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.272999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.273109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.273282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.273455] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.273552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.273615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.273896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.273987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.274125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.274238] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46c3f3e-0eeb-4c56-8053-6f8baff61565 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.274327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.274387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.274526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.274662] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.274752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.274811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.274943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.275067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.275114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.275199] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f46c3f3e-0eeb-4c56-8053-6f8baff61565',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.430957] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.430957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.430957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.430957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.430957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.430957] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9497cc12-615a-4090-934d-a1b00059825f is going to be updated. [ 691.469995] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.469995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.469995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.470317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.470360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.489603] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: IN_PROGRESS for 2s [ 691.778757] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f46c3f3e-0eeb-4c56-8053-6f8baff61565: rpc.has_security_group_logging(os_id): False [ 691.799840] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.799840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.799840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.799840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.799840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.799840] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.799840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.799840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.799840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.800624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.800624] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.800624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.800832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.801024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.801125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.802076] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.802189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.802251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.802453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.802532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.802620] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 is going to be created. [ 691.884986] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.884986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.885206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.885372] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.885595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.899352] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 in Status: IN_PROGRESS for 2s [ 692.276702] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 692.278956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.438084] env[65678]: INFO networking_nsxv3.common.synchronization [None req-1079b343-70be-4880-8b93-d873c57f149d None None] Enqueued Resource ID: 07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec with Priority: HIGHEST for action port [ 692.438652] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec with Priority: HIGHEST for action port [ 692.438972] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.439529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.439609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.439868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.439952] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.460981] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-eb7b3585-e8f5-4ec7-b325-286ac418b5db tempest-ListServersNegativeTestJSON-1141148033 tempest-ListServersNegativeTestJSON-1141148033-project-member] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 692.461381] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 692.461684] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.461803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.461862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.462310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.462513] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.462628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.462688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.462907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.463501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.463501] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.943783] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec [ 692.944544] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.944544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.944544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.944544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.944544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.944848] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec already deleted. [ 692.944848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07dd7f1a-91b1-4fe4-bd5d-59f6d78ebaec" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.968459] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.968829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.968829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.968994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.968994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.969213] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.969315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.969381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.969536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.969613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.969702] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 already deleted. [ 692.969776] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.135292] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.135576] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.136124] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.136310] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.136626] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.136908] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.137074] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.137358] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.137540] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.137907] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.138078] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.138258] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.138399] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.138596] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.138817] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.139146] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.162065] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.162262] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.162399] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.162587] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.163063] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-d0bd7af0-21c7-4ef1-8852-914f49198ed5 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.163257] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-d0bd7af0-21c7-4ef1-8852-914f49198ed5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.163377] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-d0bd7af0-21c7-4ef1-8852-914f49198ed5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.163726] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-d0bd7af0-21c7-4ef1-8852-914f49198ed5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.164293] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0bd7af0-21c7-4ef1-8852-914f49198ed5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.495906] env[65678]: INFO networking_nsxv3.common.synchronization [None req-2a312e12-f6b0-4ab3-b557-100552840a1f None None] Enqueued Resource ID: a2347595-a5a8-4d68-a2b5-0262aced20fa with Priority: HIGHEST for action port [ 693.496814] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2347595-a5a8-4d68-a2b5-0262aced20fa with Priority: HIGHEST for action port [ 693.496814] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2347595-a5a8-4d68-a2b5-0262aced20fa taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.496814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2347595-a5a8-4d68-a2b5-0262aced20fa" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.497148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2347595-a5a8-4d68-a2b5-0262aced20fa" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.497148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2347595-a5a8-4d68-a2b5-0262aced20fa" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.497236] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2347595-a5a8-4d68-a2b5-0262aced20fa',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.500910] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: SUCCESS [ 693.501124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.667902] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.668702] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.668702] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.670095] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.670095] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.670095] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port d0bd7af0-21c7-4ef1-8852-914f49198ed5 not found, creating... [ 693.670095] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.670095] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.670095] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.670494] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.670494] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.670583] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.670811] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.671053] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.671337] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.671485] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.671619] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: d0bd7af0-21c7-4ef1-8852-914f49198ed5 is going to be created. [ 693.698515] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.698515] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.698515] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.698515] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.698845] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.698845] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-d0bd7af0-21c7-4ef1-8852-914f49198ed5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.914634] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 in Status: SUCCESS [ 693.914634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.000077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2347595-a5a8-4d68-a2b5-0262aced20fa [ 694.001884] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.001884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.001884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.001884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.001884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.001884] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2347595-a5a8-4d68-a2b5-0262aced20fa already deleted. [ 694.001884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2347595-a5a8-4d68-a2b5-0262aced20fa" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.439163] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-02bf835e-50a8-4268-9052-18d6a51a14e1 service nova] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_rules [ 694.439163] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-02bf835e-50a8-4268-9052-18d6a51a14e1 service nova] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 694.439523] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-02bf835e-50a8-4268-9052-18d6a51a14e1 service nova] Enqueued Resource ID: d0bd7af0-21c7-4ef1-8852-914f49198ed5 with Priority: HIGHEST for action port [ 694.439523] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_rules [ 694.439640] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 694.439739] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0bd7af0-21c7-4ef1-8852-914f49198ed5 with Priority: HIGHEST for action port [ 694.440530] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.440600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.440600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.440911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.440960] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.442337] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.442658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.443708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.443708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.443708] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.444128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.444128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.444128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.444337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.444337] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.446261] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0bd7af0-21c7-4ef1-8852-914f49198ed5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.446261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0bd7af0-21c7-4ef1-8852-914f49198ed5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.446261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0bd7af0-21c7-4ef1-8852-914f49198ed5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.446261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0bd7af0-21c7-4ef1-8852-914f49198ed5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.446261] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0bd7af0-21c7-4ef1-8852-914f49198ed5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.949941] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.950364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.950635] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0bd7af0-21c7-4ef1-8852-914f49198ed5 with status ACTIVE [ 694.951126] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.951126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.951126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.951347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.951425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.951616] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.951714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.951777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.951959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.952055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.952261] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.952361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.952406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.953213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.954122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.954122] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0bd7af0-21c7-4ef1-8852-914f49198ed5 is going to be updated. [ 694.955420] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.983516] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.983733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.983824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.984027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.984158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.984339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0bd7af0-21c7-4ef1-8852-914f49198ed5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.071520] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-bbd3a509-d30f-438f-9950-e389abaf380a tempest-ListServersNegativeTestJSON-1141148033 tempest-ListServersNegativeTestJSON-1141148033-project-member] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 695.072438] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 695.072847] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.072985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.459591] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.656404] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.656755] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.657011] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.657667] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.657978] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.658175] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.658386] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.659186] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.659397] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.660152] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.660152] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.660152] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.660681] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.660681] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.660681] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.660681] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.682920] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.683372] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.684175] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.684421] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.684662] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.684903] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.684997] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.685362] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.685518] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('444285e4-1d88-4f80-a0ce-6d8b8b5f33e4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.803094] env[65678]: INFO networking_nsxv3.common.synchronization [None req-0c0ab838-a817-4f5f-bf73-755ce7f25b2a tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_rules [ 695.803978] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_rules [ 695.804429] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e857e4d2-27dd-462e-87df-ee44911ff684 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.805010] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.805252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.805619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.805885] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.961712] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.961871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.961928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.962170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.962269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.962396] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be created. [ 695.989051] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.989299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.989361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.989537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.989691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.000450] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: UNINITIALIZED for 2s [ 696.189098] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.189366] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.189366] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.189575] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.189722] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.189894] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 444285e4-1d88-4f80-a0ce-6d8b8b5f33e4 not found, creating... [ 696.190202] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.190362] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.190474] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.190702] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.190839] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.191134] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.191285] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.191396] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.191602] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.192139] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.192139] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 444285e4-1d88-4f80-a0ce-6d8b8b5f33e4 is going to be created. [ 696.209837] env[65678]: INFO networking_nsxv3.common.synchronization [None req-36f13251-e566-4c29-b668-18b856d8b810 None None] Enqueued Resource ID: 36972c93-9bdf-4ad1-bc42-cbd47235bbc4 with Priority: HIGHEST for action port [ 696.210508] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36972c93-9bdf-4ad1-bc42-cbd47235bbc4 with Priority: HIGHEST for action port [ 696.210832] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-36972c93-9bdf-4ad1-bc42-cbd47235bbc4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.210960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36972c93-9bdf-4ad1-bc42-cbd47235bbc4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.211150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36972c93-9bdf-4ad1-bc42-cbd47235bbc4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.211508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36972c93-9bdf-4ad1-bc42-cbd47235bbc4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.211594] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36972c93-9bdf-4ad1-bc42-cbd47235bbc4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.214830] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.215312] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.215468] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.216821] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.217298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.217541] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.336279] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.336513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.336513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.336764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.336916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.337156] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e857e4d2-27dd-462e-87df-ee44911ff684 already deleted. [ 696.337267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.400498] env[65678]: INFO networking_nsxv3.common.synchronization [None req-047db147-f011-4d16-b038-3dfc3f3bec84 None None] Enqueued Resource ID: 04d477c7-eb4c-4d84-a800-180f0efa397f with Priority: HIGHEST for action port [ 696.401230] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d477c7-eb4c-4d84-a800-180f0efa397f with Priority: HIGHEST for action port [ 696.401573] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-04d477c7-eb4c-4d84-a800-180f0efa397f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.401683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04d477c7-eb4c-4d84-a800-180f0efa397f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.401754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04d477c7-eb4c-4d84-a800-180f0efa397f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.402123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04d477c7-eb4c-4d84-a800-180f0efa397f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.402257] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04d477c7-eb4c-4d84-a800-180f0efa397f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.714781] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36972c93-9bdf-4ad1-bc42-cbd47235bbc4 [ 696.715017] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.715170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.715237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.715452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.715543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.715640] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36972c93-9bdf-4ad1-bc42-cbd47235bbc4 already deleted. [ 696.715722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36972c93-9bdf-4ad1-bc42-cbd47235bbc4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.907057] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04d477c7-eb4c-4d84-a800-180f0efa397f [ 696.908320] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.908320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.908320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.908320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.908320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.908320] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04d477c7-eb4c-4d84-a800-180f0efa397f already deleted. [ 696.908320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04d477c7-eb4c-4d84-a800-180f0efa397f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.976027] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-11d014c0-6a7b-4089-bff0-b6397432105b service nova] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_rules [ 696.976240] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-11d014c0-6a7b-4089-bff0-b6397432105b service nova] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 696.976240] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-11d014c0-6a7b-4089-bff0-b6397432105b service nova] Enqueued Resource ID: 444285e4-1d88-4f80-a0ce-6d8b8b5f33e4 with Priority: HIGHEST for action port [ 696.976734] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_rules [ 696.977333] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 696.977333] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444285e4-1d88-4f80-a0ce-6d8b8b5f33e4 with Priority: HIGHEST for action port [ 696.978925] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.979127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.979297] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.979397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.979577] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.980208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.980299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.980757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.980881] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('444285e4-1d88-4f80-a0ce-6d8b8b5f33e4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.984915] env[65678]: INFO networking_nsxv3.common.synchronization [req-096fd249-8686-4bc5-bcb2-d9b8afc3a5ae req-f3b688f8-8853-4b61-88ae-a53f0dd8a8df tempest-DeleteServersAdminTestJSON-1802841318 tempest-DeleteServersAdminTestJSON-1802841318-project-member] Enqueued Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 696.985935] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGHEST for action security_group_members [ 696.986367] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.986526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.986601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.987458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.987655] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.988729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.988824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.990933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.991941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.991941] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.097928] env[65678]: INFO networking_nsxv3.common.synchronization [None req-886612f2-f8a5-4587-9b60-c88611320fdd tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_rules [ 697.098484] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_rules [ 697.098823] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e857e4d2-27dd-462e-87df-ee44911ff684 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.098925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.098988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.099446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.099659] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.212603] env[65678]: INFO networking_nsxv3.common.synchronization [req-1ee3fe8e-5dc1-45e5-93cb-c834456a14be req-8860d984-9aef-4f3d-9a31-282d88a920fa tempest-ServerAddressesNegativeTestJSON-1897348883 tempest-ServerAddressesNegativeTestJSON-1897348883-project-member] Enqueued Resource ID: cddb9167-1b9c-4751-8cf3-4f83a593874e with Priority: HIGHEST for action security_group_members [ 697.215786] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cddb9167-1b9c-4751-8cf3-4f83a593874e with Priority: HIGHEST for action security_group_members [ 697.215786] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cddb9167-1b9c-4751-8cf3-4f83a593874e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.215786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.215786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.215786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.215786] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.215786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.215786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.215786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.215786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.215786] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cddb9167-1b9c-4751-8cf3-4f83a593874e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.487212] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 444285e4-1d88-4f80-a0ce-6d8b8b5f33e4 with status ACTIVE [ 697.487448] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.487585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.487655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.487891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.488293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.488293] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.488293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.488494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.488494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.488563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.488705] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.488799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.488861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.489193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.489277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.489389] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 444285e4-1d88-4f80-a0ce-6d8b8b5f33e4 is going to be updated. [ 697.494994] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.495160] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.495213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.495789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.495878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.496070] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.496180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.496244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.496404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.496484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.496573] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db is going to be updated. [ 697.516253] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.516253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.516253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.516253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.516253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.516253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-444285e4-1d88-4f80-a0ce-6d8b8b5f33e4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.528064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.528210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.528285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.529790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.529790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.541016] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: IN_PROGRESS for 2s [ 697.636414] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.636414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.636414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.636676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.636676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.636748] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e857e4d2-27dd-462e-87df-ee44911ff684 already deleted. [ 697.636952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.659965] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-299bcfd1-fc88-4520-9602-144e250c5768 tempest-ListServersNegativeTestJSON-1141148033 tempest-ListServersNegativeTestJSON-1141148033-project-member] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 697.661106] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 697.661106] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.661240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.717939] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.721209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.721209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.721209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.721209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.721209] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.721209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.721209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.721209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.721209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.721209] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddb9167-1b9c-4751-8cf3-4f83a593874e is going to be updated. [ 697.749053] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.749585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.749841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.750090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.750330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.760218] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddb9167-1b9c-4751-8cf3-4f83a593874e in Status: IN_PROGRESS for 2s [ 698.012307] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 698.012307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.012580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.012622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.012842] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.013254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.013254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.013417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.013417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.013775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.013775] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.016043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.016043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.016043] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.016043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.016043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.016043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.016043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.016618] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.050163] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.050445] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.050645] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.050976] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.051283] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.051458] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.051648] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.051893] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.051998] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.053028] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.053028] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.053028] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.053028] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.053028] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.053028] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.053446] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.089252] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.089313] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.090047] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.090047] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-120" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.090047] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.090047] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.090317] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.090476] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.090606] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa257a7d-4f0e-4bcc-aa67-12d3b0f76126',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.102985] env[65678]: INFO networking_nsxv3.common.synchronization [req-28b94866-f662-4b62-a7cc-d0f45d97f2a5 req-cb428bc8-9a7c-4a6f-b554-9e7211281048 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 698.102985] env[65678]: INFO networking_nsxv3.common.synchronization [req-28b94866-f662-4b62-a7cc-d0f45d97f2a5 req-cb428bc8-9a7c-4a6f-b554-9e7211281048 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 698.103265] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 698.103504] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 698.103664] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.103794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.103924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.104256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.106030] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.106030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.106030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.106030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.106030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.106030] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.106616] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.106616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.106616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.106616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.106616] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.106813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.106813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.106880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.106945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.107034] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.152018] env[65678]: INFO networking_nsxv3.common.synchronization [req-28b94866-f662-4b62-a7cc-d0f45d97f2a5 req-cb428bc8-9a7c-4a6f-b554-9e7211281048 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 698.152018] env[65678]: INFO networking_nsxv3.common.synchronization [req-28b94866-f662-4b62-a7cc-d0f45d97f2a5 req-cb428bc8-9a7c-4a6f-b554-9e7211281048 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 698.152018] env[65678]: INFO networking_nsxv3.common.synchronization [req-28b94866-f662-4b62-a7cc-d0f45d97f2a5 req-cb428bc8-9a7c-4a6f-b554-9e7211281048 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_rules [ 698.152018] env[65678]: INFO networking_nsxv3.common.synchronization [req-28b94866-f662-4b62-a7cc-d0f45d97f2a5 req-cb428bc8-9a7c-4a6f-b554-9e7211281048 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 698.152018] env[65678]: INFO networking_nsxv3.common.synchronization [req-28b94866-f662-4b62-a7cc-d0f45d97f2a5 req-cb428bc8-9a7c-4a6f-b554-9e7211281048 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: b38c7b49-b436-4943-8213-9356eccb8997 with Priority: HIGHEST for action port [ 698.152018] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 698.152018] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_rules [ 698.152018] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b38c7b49-b436-4943-8213-9356eccb8997 with Priority: HIGHEST for action port [ 698.152018] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 698.152713] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 698.153483] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.153772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.154609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.154609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.154609] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.155283] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.155283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.155480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.155597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.155663] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.156656] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b38c7b49-b436-4943-8213-9356eccb8997 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.156749] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.156830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.157015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.158227] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38c7b49-b436-4943-8213-9356eccb8997',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.158988] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.159283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.159372] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.159507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.516568] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.516907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.518185] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.593341] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.593647] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.595122] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.595122] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.595122] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.595122] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port aa257a7d-4f0e-4bcc-aa67-12d3b0f76126 not found, creating... [ 698.596377] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.596377] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.596377] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.596377] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.596599] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.596763] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.596922] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.597039] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.597259] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.597381] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.597538] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: aa257a7d-4f0e-4bcc-aa67-12d3b0f76126 is going to be created. [ 698.599834] env[65678]: INFO networking_nsxv3.common.synchronization [None req-b183ef5c-b092-41cc-95fa-4689fbce6967 None None] Enqueued Resource ID: ba4ad718-2c53-47d2-bcbf-0b838fca0ca6 with Priority: HIGHEST for action port [ 698.600413] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba4ad718-2c53-47d2-bcbf-0b838fca0ca6 with Priority: HIGHEST for action port [ 698.601154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba4ad718-2c53-47d2-bcbf-0b838fca0ca6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.601267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba4ad718-2c53-47d2-bcbf-0b838fca0ca6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.601343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba4ad718-2c53-47d2-bcbf-0b838fca0ca6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.601592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba4ad718-2c53-47d2-bcbf-0b838fca0ca6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.601679] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba4ad718-2c53-47d2-bcbf-0b838fca0ca6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.606303] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.608810] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.631589] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.631589] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.631589] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.633320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.633320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.633320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.660883] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.661088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.661335] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.661645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.661645] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b38c7b49-b436-4943-8213-9356eccb8997 with status ACTIVE [ 698.661769] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.661874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.661942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.662151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.662266] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.662437] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.662552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.662900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.662900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.663038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.663174] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.663296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.663364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.663574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.663663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.663783] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b38c7b49-b436-4943-8213-9356eccb8997 is going to be updated. [ 698.692451] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.692451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.692451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.692451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.692451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.692775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.020503] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.103891] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba4ad718-2c53-47d2-bcbf-0b838fca0ca6 [ 699.104138] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.104412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.104412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.104658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.104658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.104745] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba4ad718-2c53-47d2-bcbf-0b838fca0ca6 already deleted. [ 699.104787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba4ad718-2c53-47d2-bcbf-0b838fca0ca6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.108147] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.110345] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.342657] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-51a16ddd-da8f-4adc-9b0b-d06646641f12 service nova] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_rules [ 699.342911] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-51a16ddd-da8f-4adc-9b0b-d06646641f12 service nova] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 699.343794] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e31f947-b9da-404b-a8e0-983e3d75a2eb req-51a16ddd-da8f-4adc-9b0b-d06646641f12 service nova] Enqueued Resource ID: aa257a7d-4f0e-4bcc-aa67-12d3b0f76126 with Priority: HIGHEST for action port [ 699.344397] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_rules [ 699.344536] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 699.344628] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa257a7d-4f0e-4bcc-aa67-12d3b0f76126 with Priority: HIGHEST for action port [ 699.344934] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.345124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.345357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.345419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.345737] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.345737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.345737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.345962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.346019] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa257a7d-4f0e-4bcc-aa67-12d3b0f76126',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.523618] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.524084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.524084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.524212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.524346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.524490] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be updated. [ 699.557038] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db in Status: SUCCESS [ 699.557330] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db deletion is rescheduled due to dependency. [ 699.557525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.559693] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.559693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.559904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.559966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.561211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.571341] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 699.612519] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.612519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.612519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.612519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.612519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.612519] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 is going to be created. [ 699.613453] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.613571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.613638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.613813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.613911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.614023] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 699.642180] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.642290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.642345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.642787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.642999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.645827] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.646234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.646234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.646234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.646384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.659680] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 699.661061] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: UNINITIALIZED for 2s [ 699.777237] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cddb9167-1b9c-4751-8cf3-4f83a593874e in Status: SUCCESS [ 699.777237] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cddb9167-1b9c-4751-8cf3-4f83a593874e deletion is rescheduled due to dependency. [ 699.777237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cddb9167-1b9c-4751-8cf3-4f83a593874e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.848565] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa257a7d-4f0e-4bcc-aa67-12d3b0f76126 with status ACTIVE [ 699.848932] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.849059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.849131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.849374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.849469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.849729] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.849808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.849880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.850147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.850271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.850554] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.850677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.850885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.851077] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.852141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.852141] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa257a7d-4f0e-4bcc-aa67-12d3b0f76126 is going to be updated. [ 699.906891] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.906891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.906891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.906891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.906891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.906891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa257a7d-4f0e-4bcc-aa67-12d3b0f76126" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.619133] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 with Priority: HIGHEST for action security_group_members [ 700.619133] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 700.619133] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 700.619133] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 with Priority: HIGHEST for action security_group_members [ 700.619133] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 700.619133] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 700.619932] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-394e9a35-6053-4366-8c10-efbb3bbed0b9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.620238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.620421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.620774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.623519] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.623519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.623519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.623519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.623519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.623519] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.623519] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.623519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.624055] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.624287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.685134] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 700.685390] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 700.685572] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 with Priority: HIGHEST for action security_group_rules [ 700.685752] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 with Priority: HIGHEST for action security_group_members [ 700.685938] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_rules [ 700.686131] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 700.686393] env[65678]: INFO networking_nsxv3.common.synchronization [req-56534a67-973a-4ca2-bc39-92e0b9553df4 req-575b69d1-eed5-4c30-803e-56c9a1b00f4f tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: b38c7b49-b436-4943-8213-9356eccb8997 with Priority: HIGHEST for action port [ 700.687960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 700.687960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 with Priority: HIGHEST for action security_group_rules [ 700.687960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 700.687960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b38c7b49-b436-4943-8213-9356eccb8997 with Priority: HIGHEST for action port [ 700.687960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_rules [ 700.687960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 700.687960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 with Priority: HIGHEST for action security_group_members [ 700.687960] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.687960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.688365] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-394e9a35-6053-4366-8c10-efbb3bbed0b9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.688444] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.688517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.689197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.689197] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.692250] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.692364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.692556] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b38c7b49-b436-4943-8213-9356eccb8997 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.692653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.692782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.692987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.693084] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38c7b49-b436-4943-8213-9356eccb8997',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.693963] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.694102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.694246] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.694326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.694670] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-394e9a35-6053-4366-8c10-efbb3bbed0b9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.694670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.126028] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.195958] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-394e9a35-6053-4366-8c10-efbb3bbed0b9 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.195958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.195958] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b38c7b49-b436-4943-8213-9356eccb8997 with status ACTIVE [ 701.196225] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.196225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.196225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.197029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.197029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.197029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.197029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.197029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.197029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.197029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.197288] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.197288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.197428] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.197452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.197530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.197600] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b38c7b49-b436-4943-8213-9356eccb8997 is going to be updated. [ 701.220309] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.220309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.220309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.220309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.220309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.220309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b38c7b49-b436-4943-8213-9356eccb8997" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.583750] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 701.584018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.584271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.584495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.584682] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.584813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.584876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.585095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.585194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.585315] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.629055] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.669979] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: SUCCESS [ 701.670217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.670383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.670667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.670792] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.670911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.670975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.671175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.671334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.671432] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.673017] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 701.673205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.673863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.674109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.674353] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.674498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.674570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.674784] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.676825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.676825] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.088503] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.131096] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.131596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.131789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.133852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.133852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.133852] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 is going to be created. [ 702.157678] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.160021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.160021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.160021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.160021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.169535] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 in Status: UNINITIALIZED for 2s [ 702.178802] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.178802] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.592700] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.684072] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.684072] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.076858] env[65678]: INFO networking_nsxv3.common.synchronization [req-443f4487-0166-4c87-867a-d1dd329a0c0a req-f7c7e675-bcf8-4d1b-a21d-5adcc030fbbc tempest-ImagesOneServerNegativeTestJSON-281812694 tempest-ImagesOneServerNegativeTestJSON-281812694-project-member] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 703.077488] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 703.077912] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.078015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.078107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.078725] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.078725] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.078879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.078879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.079042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.079103] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.079202] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.095746] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.095846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.095846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.096060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.096170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.096313] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be updated. [ 703.132197] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.132452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.132539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.132785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.132950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.144464] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 703.185171] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.186440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.186440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.186440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.186440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.186440] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 703.187216] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.187216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.187216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.187352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.187432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.187507] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 is going to be updated. [ 703.243534] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.243736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.243736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.243967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.244134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.246864] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.247101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.247101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.247256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.247386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.261518] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: IN_PROGRESS for 2s [ 703.262351] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 703.584021] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-408 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.584021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.584021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.584021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.584021] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.584021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.584021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.584021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.584021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.584021] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.584672] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.584865] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.585187] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.585386] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.585517] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.585674] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.587038] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.587165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.587233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.587419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.587502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.587772] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.587856] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.587908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.588027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.588107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.588199] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 already deleted. [ 703.588281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.608028] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.608265] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.608416] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.608607] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.608916] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-9d8db456-87df-45a2-a97a-38a54a3c8361 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.609591] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-9d8db456-87df-45a2-a97a-38a54a3c8361" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.609591] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-9d8db456-87df-45a2-a97a-38a54a3c8361" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.609591] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-9d8db456-87df-45a2-a97a-38a54a3c8361" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.609591] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d8db456-87df-45a2-a97a-38a54a3c8361',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.116374] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.116741] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.116779] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.117097] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.117265] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.117426] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 9d8db456-87df-45a2-a97a-38a54a3c8361 not found, creating... [ 704.117728] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.117914] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.118055] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.118320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.118483] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.118782] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.118946] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.119097] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.122735] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.122735] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.122735] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 9d8db456-87df-45a2-a97a-38a54a3c8361 is going to be created. [ 704.122918] env[65678]: INFO networking_nsxv3.common.synchronization [req-ad915877-babb-432e-80e6-f2d59d681944 req-81325ea0-b046-4bf9-b195-e732d388f27c tempest-ServerMetadataNegativeTestJSON-1716865601 tempest-ServerMetadataNegativeTestJSON-1716865601-project-member] Enqueued Resource ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 with Priority: HIGHEST for action security_group_members [ 704.123873] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 with Priority: HIGHEST for action security_group_members [ 704.124219] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-cda39a55-69e8-4fac-bca6-eac8c60627f3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.124355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.124409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.124587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.124744] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.124842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.124901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.125079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.125204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.125350] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cda39a55-69e8-4fac-bca6-eac8c60627f3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.159605] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.159889] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.159948] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.160391] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.160857] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.161136] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-9d8db456-87df-45a2-a97a-38a54a3c8361" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.181330] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 in Status: SUCCESS [ 704.181536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.181697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.181985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.182113] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.182238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.182294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.183350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.183350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.183350] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.628126] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.628302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.628362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.628572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.628685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.629102] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.629203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.629267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.629430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.629508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.629596] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 is going to be updated. [ 704.662993] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.663210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.663356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.663618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.663852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.673183] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 in Status: IN_PROGRESS for 2s [ 704.685609] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.868620] env[65678]: INFO networking_nsxv3.common.synchronization [None req-381baca2-35b4-463a-8177-81d58ef7f9a4 tempest-MigrationsAdminTest-513313397 tempest-MigrationsAdminTest-513313397-project-member] Enqueued Resource ID: def74fbf-0448-49c2-9467-e54902b18276 with Priority: HIGHEST for action security_group_rules [ 704.869537] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def74fbf-0448-49c2-9467-e54902b18276 with Priority: HIGHEST for action security_group_rules [ 704.869951] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def74fbf-0448-49c2-9467-e54902b18276 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.870167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def74fbf-0448-49c2-9467-e54902b18276" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.870261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def74fbf-0448-49c2-9467-e54902b18276" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.870806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def74fbf-0448-49c2-9467-e54902b18276" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.870936] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def74fbf-0448-49c2-9467-e54902b18276',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.157418] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 705.157418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.157418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.157418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.157418] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.157418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.157418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.157418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.157418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.157418] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.188175] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.274063] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: SUCCESS [ 705.274395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.275643] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 705.275643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.275808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.276129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.276355] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.276500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.276585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.276774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.276900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.277022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.277252] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.278140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.278949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.280023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.280303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.280423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.280714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.283571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.283571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.283571] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.283571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.283571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.283571] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.283571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.283571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.283571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.283571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.283571] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.284799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.285082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.285361] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.285580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.286287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.286503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.286596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.286693] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.338359] env[65678]: INFO networking_nsxv3.common.synchronization [req-2a221f18-cce3-40c0-894d-63cfd77e4efb req-3c7990bb-edc7-49f4-8969-7f722789789b tempest-AttachInterfacesV270Test-929008870 tempest-AttachInterfacesV270Test-929008870-project-member] Enqueued Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGHEST for action security_group_members [ 705.339187] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGHEST for action security_group_members [ 705.339614] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8085af0-0afc-45eb-a26a-73aa0c8599a4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.339839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.339839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.340118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.340242] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.340399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.340492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.340695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.340796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.340892] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8085af0-0afc-45eb-a26a-73aa0c8599a4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.392587] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.392871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.392871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.393122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.393226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.393368] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def74fbf-0448-49c2-9467-e54902b18276 already deleted. [ 705.394742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def74fbf-0448-49c2-9467-e54902b18276" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.450336] env[65678]: INFO networking_nsxv3.common.synchronization [req-443f4487-0166-4c87-867a-d1dd329a0c0a req-d90cc847-61f1-4fdf-812d-c5da1335c367 service nova] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_rules [ 705.450556] env[65678]: INFO networking_nsxv3.common.synchronization [req-443f4487-0166-4c87-867a-d1dd329a0c0a req-d90cc847-61f1-4fdf-812d-c5da1335c367 service nova] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 705.450783] env[65678]: INFO networking_nsxv3.common.synchronization [req-443f4487-0166-4c87-867a-d1dd329a0c0a req-d90cc847-61f1-4fdf-812d-c5da1335c367 service nova] Enqueued Resource ID: 9d8db456-87df-45a2-a97a-38a54a3c8361 with Priority: HIGHEST for action port [ 705.452167] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_rules [ 705.452356] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 705.452549] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8db456-87df-45a2-a97a-38a54a3c8361 with Priority: HIGHEST for action port [ 705.452965] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.453167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.453311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.454048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.454186] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.455623] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.455811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.455913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.456174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.456371] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.456497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.456645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.456846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.456971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.457105] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.462317] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d8db456-87df-45a2-a97a-38a54a3c8361 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.462317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d8db456-87df-45a2-a97a-38a54a3c8361" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.462317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d8db456-87df-45a2-a97a-38a54a3c8361" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.462317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d8db456-87df-45a2-a97a-38a54a3c8361" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.462317] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d8db456-87df-45a2-a97a-38a54a3c8361',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.556251] env[65678]: INFO networking_nsxv3.common.synchronization [None req-4fb0c284-eeb0-4fd3-8924-be54049d86e7 tempest-MigrationsAdminTest-513313397 tempest-MigrationsAdminTest-513313397-project-member] Enqueued Resource ID: def74fbf-0448-49c2-9467-e54902b18276 with Priority: HIGHEST for action security_group_rules [ 705.556858] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def74fbf-0448-49c2-9467-e54902b18276 with Priority: HIGHEST for action security_group_rules [ 705.557317] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def74fbf-0448-49c2-9467-e54902b18276 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.557735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def74fbf-0448-49c2-9467-e54902b18276" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.557735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def74fbf-0448-49c2-9467-e54902b18276" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.557818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def74fbf-0448-49c2-9467-e54902b18276" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.557871] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def74fbf-0448-49c2-9467-e54902b18276',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.558192] env[65678]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 705.661431] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.693180] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.693180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.693180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.693180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.693180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.693180] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 is going to be updated. [ 705.725041] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.725041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.725041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.725041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.725041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.742480] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 in Status: IN_PROGRESS for 2s [ 705.783124] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.789436] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.790979] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.791167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.792095] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.843174] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.843406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.843498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.843794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.844134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.844134] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.844245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.844245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.844390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.844505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.844622] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 is going to be updated. [ 705.903188] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.903188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.903188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.903188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.903188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.919029] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 in Status: IN_PROGRESS for 2s [ 705.963361] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.963610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.963763] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.964656] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d8db456-87df-45a2-a97a-38a54a3c8361 with status ACTIVE [ 705.965141] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.965312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.965401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.967029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.967029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.967029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.967029] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d8db456-87df-45a2-a97a-38a54a3c8361 is going to be updated. [ 705.994594] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.994811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.994811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.995098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.995249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.995462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d8db456-87df-45a2-a97a-38a54a3c8361" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.080763] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.080938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.081065] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.081226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.081318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.081417] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def74fbf-0448-49c2-9467-e54902b18276 already deleted. [ 706.081497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def74fbf-0448-49c2-9467-e54902b18276" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.164694] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.287569] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6eb745b-f38e-4b8f-9261-fe65a6934037: rpc.has_security_group_logging(os_id): False [ 706.294376] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.295389] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.310213] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.310362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.310429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.310784] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.310881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.311131] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.311231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.311291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.311453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.311524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.311607] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 is going to be created. [ 706.446847] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.447048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.447086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.447279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.447447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.460117] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: IN_PROGRESS for 2s [ 706.469469] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.668535] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.668696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.668760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.668988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.669097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.669227] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be updated. [ 706.683177] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 in Status: SUCCESS [ 706.683354] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cda39a55-69e8-4fac-bca6-eac8c60627f3 deletion is rescheduled due to dependency. [ 706.683468] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cda39a55-69e8-4fac-bca6-eac8c60627f3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.703106] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.703106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.703106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.703106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.703106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.713111] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 706.797547] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.798165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.798165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.798165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.798165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.798165] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 is going to be updated. [ 706.800624] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.800624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.800624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.800624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.800624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.800624] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 706.830363] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.830512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.830606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.832793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.832793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.832793] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.832793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.833013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.833049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.833288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.847789] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 706.848506] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: IN_PROGRESS for 2s [ 706.971427] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.971607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.971667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.971862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.973024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.973024] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be created. [ 707.004958] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.005150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.006926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.006926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.006926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.018490] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: UNINITIALIZED for 2s [ 707.556419] env[65678]: INFO networking_nsxv3.common.synchronization [req-c3f32ea1-dcd0-4a00-80fa-041823c54275 req-6b84ac97-c19a-414c-b3ca-773684261f09 tempest-TenantUsagesTestJSON-1995132264 tempest-TenantUsagesTestJSON-1995132264-project-member] Enqueued Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGHEST for action security_group_members [ 707.558154] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGHEST for action security_group_members [ 707.558154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b98b8977-5505-4665-ad19-ac6d8455a014 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.558154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.558154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.558154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.558154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.558154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.558154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.558503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.558503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.559062] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b98b8977-5505-4665-ad19-ac6d8455a014',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.755925] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 in Status: SUCCESS [ 707.756314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.756586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.756853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.757180] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.757180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.757293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.757389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.757448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.757530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.757628] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.930679] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 in Status: SUCCESS [ 707.930929] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 deletion is rescheduled due to dependency. [ 707.931305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.062053] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.062717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.062717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.062717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.062717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.062875] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.063787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.063838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.064834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.064834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.064834] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b98b8977-5505-4665-ad19-ac6d8455a014 is going to be updated. [ 708.097198] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.097351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.097452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.097629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.097772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.107500] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b98b8977-5505-4665-ad19-ac6d8455a014 in Status: IN_PROGRESS for 2s [ 708.261175] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.477752] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: SUCCESS [ 708.477868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.478156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.478386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.478521] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.726157] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 708.726404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.726612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.726717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.726938] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.727081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.727523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.727523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.727523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.727523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.727726] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.727779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.727852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.727974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.728263] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.728355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.728404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.728578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.728669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.728769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.728888] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.729915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.730142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.730324] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.730940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.730940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.730940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.730940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.730940] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.763437] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 394e9a35-6053-4366-8c10-efbb3bbed0b9: rpc.has_security_group_logging(os_id): False [ 708.785023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.785212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.785403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.785536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.785665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.785936] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.786061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.786100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.786270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.786350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.786463] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 is going to be created. [ 708.864868] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.865858] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.866768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.866768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.866768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.869135] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 708.869541] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.870425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.870425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.870425] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.870425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.870670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.871391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.871599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.871785] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.873815] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: SUCCESS [ 708.875924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.876073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.876718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.876718] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.876718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.876718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.876943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.876943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.876943] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.878639] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 in Status: IN_PROGRESS for 2s [ 708.983931] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.983931] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.033073] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 709.033073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.033073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.033073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.033073] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.033073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.033073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.033073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.033073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.033073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.033073] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.077047] env[65678]: INFO networking_nsxv3.common.synchronization [req-0e9876f8-3622-4f48-ac55-d682fc8e2aff req-9e4fc439-a2df-40f7-b484-f553e868fc74 tempest-ServerExternalEventsTest-797176871 tempest-ServerExternalEventsTest-797176871-project-member] Enqueued Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGHEST for action security_group_members [ 709.078581] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGHEST for action security_group_members [ 709.078945] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f46c3f3e-0eeb-4c56-8053-6f8baff61565 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.079108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.079178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.079384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.079542] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.079653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.079699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.080310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.080310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.080310] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f46c3f3e-0eeb-4c56-8053-6f8baff61565',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.232587] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6bf254fe-a02c-4c36-8f89-52a5a801f9b5: rpc.has_security_group_logging(os_id): False [ 709.233947] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.257701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.257884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.257976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.258269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.258409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.258688] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.258838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.258934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.259179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.259293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.259940] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.259940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.259940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.260126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.260126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.260414] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.260529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.260610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.260844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.260963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.261091] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be created. [ 709.333539] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.333656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.333744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.334085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.334182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.346396] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 709.378357] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.379319] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.534605] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.534812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.534939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.535466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.535567] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.535752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.535897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.536109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.536251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.536415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.536641] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.536795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.536931] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.537141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.537413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.537540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.537622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.537964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.537964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.538163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.538296] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.582570] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.582779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.582852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.583089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.583197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.583389] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.583657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.583657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.583741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.583806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.583870] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 is going to be updated. [ 709.611507] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.611507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.611507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.611507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.611507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.623079] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 in Status: IN_PROGRESS for 2s [ 709.736548] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.882973] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.883949] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.034023] env[65678]: INFO networking_nsxv3.common.synchronization [req-aa23422f-2631-4a63-a455-c2fbe765b7d4 req-bdf5baaa-6575-47eb-be05-eeecbb375f09 tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 710.034806] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 710.034992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.035126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.035164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.035500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.035665] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.035769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.036225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.036225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.036225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.036225] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.041170] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b634fd1e-f1ec-4189-ac44-9f8fa9578204: rpc.has_security_group_logging(os_id): False [ 710.061779] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.061954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.062042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.062485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.062485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.062626] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.062719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.062808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.062968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.063960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.063960] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.063960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.063960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.063960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.063960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.064314] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.064314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.064391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.064480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.064553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.064638] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be created. [ 710.088863] env[65678]: INFO networking_nsxv3.common.synchronization [req-ad42fce1-83e0-4ff6-a628-b373db6a8067 req-ca4bef93-cc7d-4c26-9aee-e20c8180073e tempest-ServersTestJSON-1589036422 tempest-ServersTestJSON-1589036422-project-member] Enqueued Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_members [ 710.089637] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGHEST for action security_group_members [ 710.089986] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-40537b9d-ed59-4875-a8af-108e1322d055 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.090929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.090929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.090929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.090929] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.091473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.091534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.091796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.092084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.092275] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40537b9d-ed59-4875-a8af-108e1322d055',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.118167] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b98b8977-5505-4665-ad19-ac6d8455a014 in Status: SUCCESS [ 710.118352] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b98b8977-5505-4665-ad19-ac6d8455a014 deletion is rescheduled due to dependency. [ 710.118463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.136024] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.136024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.136024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.136024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.136024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.148151] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 710.239426] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.239657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.239742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.240110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.240214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.240326] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be updated. [ 710.291298] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.292100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.292100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.292100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.292100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.318337] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 710.386194] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.386447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.386542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.386982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.387121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.387274] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 is going to be updated. [ 710.390615] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.390932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.392614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.392614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.392614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.392614] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 710.429818] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.430061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.430315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.430777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.430859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.433769] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.434181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.434323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.434638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.434839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.451166] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 710.451956] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: IN_PROGRESS for 2s [ 710.534946] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.534946] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.535182] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.536104] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.536104] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.536104] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.536104] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.536251] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.536385] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.536622] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.536737] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.536979] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.537126] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.537445] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.537670] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.540341] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.542123] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.542387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.542387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.542518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.542605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.542860] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.542973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.543066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.543219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.543299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.543397] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 710.569516] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.569744] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.570033] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.570124] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.570430] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-147a2555-4d1b-4c6d-8dab-8487edf361d8 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.570620] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-147a2555-4d1b-4c6d-8dab-8487edf361d8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.570771] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-147a2555-4d1b-4c6d-8dab-8487edf361d8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.571543] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-147a2555-4d1b-4c6d-8dab-8487edf361d8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.572421] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('147a2555-4d1b-4c6d-8dab-8487edf361d8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.576812] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.576812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.576812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.576812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.576812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.589289] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 710.598145] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.598145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.598145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.598145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.598145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.598145] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.598145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.598145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.598145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.598145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.598145] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40537b9d-ed59-4875-a8af-108e1322d055 is going to be updated. [ 710.629181] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.629181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.629181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.629181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.631037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.639243] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40537b9d-ed59-4875-a8af-108e1322d055 in Status: IN_PROGRESS for 2s [ 710.895572] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 in Status: SUCCESS [ 710.896546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.078298] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.078298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.078298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.078298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.078298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.078298] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 147a2555-4d1b-4c6d-8dab-8487edf361d8 not found, creating... [ 711.078298] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.078298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.078298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.078298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.078298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.078940] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.078940] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.078940] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.084996] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.084996] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.084996] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 147a2555-4d1b-4c6d-8dab-8487edf361d8 is going to be created. [ 711.107520] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.107520] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.107520] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.107520] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.107520] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.107520] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-147a2555-4d1b-4c6d-8dab-8487edf361d8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.359386] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 711.359610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.359803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.360032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.360118] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.634643] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 in Status: SUCCESS [ 711.634857] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 deletion is rescheduled due to dependency. [ 711.634998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.864249] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.864390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.888629] env[65678]: INFO networking_nsxv3.common.synchronization [req-aa23422f-2631-4a63-a455-c2fbe765b7d4 req-ab388b1e-b9de-48a2-bcfa-f528773d9365 service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 711.888805] env[65678]: INFO networking_nsxv3.common.synchronization [req-aa23422f-2631-4a63-a455-c2fbe765b7d4 req-ab388b1e-b9de-48a2-bcfa-f528773d9365 service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 711.888933] env[65678]: INFO networking_nsxv3.common.synchronization [req-aa23422f-2631-4a63-a455-c2fbe765b7d4 req-ab388b1e-b9de-48a2-bcfa-f528773d9365 service nova] Enqueued Resource ID: 147a2555-4d1b-4c6d-8dab-8487edf361d8 with Priority: HIGHEST for action port [ 711.889439] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 711.889689] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 711.889828] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 147a2555-4d1b-4c6d-8dab-8487edf361d8 with Priority: HIGHEST for action port [ 711.892394] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.892394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.892394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.892552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.892552] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.893906] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.894029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.895052] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-147a2555-4d1b-4c6d-8dab-8487edf361d8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.895052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-147a2555-4d1b-4c6d-8dab-8487edf361d8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.895052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-147a2555-4d1b-4c6d-8dab-8487edf361d8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.895052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-147a2555-4d1b-4c6d-8dab-8487edf361d8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.895052] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('147a2555-4d1b-4c6d-8dab-8487edf361d8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.162411] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 712.162711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.330325] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 712.330425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.330543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.330766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.331119] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.331293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.331293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.331441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.331529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.331619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.331705] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.394787] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.394937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.398271] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 147a2555-4d1b-4c6d-8dab-8487edf361d8 with status ACTIVE [ 712.398467] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.398932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.398932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.398932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.398932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.399166] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.399212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.399270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.399527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.399527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.400162] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.400162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.400162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.400162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.400162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.400162] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 147a2555-4d1b-4c6d-8dab-8487edf361d8 is going to be updated. [ 712.427794] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.427958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.427958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.428188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.428327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.428559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-147a2555-4d1b-4c6d-8dab-8487edf361d8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.464588] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 712.464771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.464958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.465278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.465397] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.465557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.465626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.465810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.465879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.465981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.466186] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.466344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.466344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.466799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.466946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.467113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.467155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.467301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.467423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.467520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.467599] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.469449] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: SUCCESS [ 712.469676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.469840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.470026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.470192] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.470298] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.470363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.472220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.472220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.472220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.472220] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.602241] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 712.602443] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d deletion is rescheduled due to dependency. [ 712.602541] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.603421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.603670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.603971] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.604132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.604221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.604414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.604530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.604680] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.650659] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40537b9d-ed59-4875-a8af-108e1322d055 in Status: SUCCESS [ 712.651186] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40537b9d-ed59-4875-a8af-108e1322d055 deletion is rescheduled due to dependency. [ 712.651330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40537b9d-ed59-4875-a8af-108e1322d055" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.834331] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.836036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.836036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.836036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.836522] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.836522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.836522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.836522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.836680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.836707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.836856] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.836960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.837063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.837267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.837382] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.837536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.837536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.837683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.838461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.838461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.838461] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.972809] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393a6f14-3ce6-441b-a403-1993c47b58e3: rpc.has_security_group_logging(os_id): False [ 712.976872] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.998680] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.998848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.998905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.999127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.999414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.999453] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.999542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.999588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.999743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.999792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.000249] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.000249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.000249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.000464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.000464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.000581] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.001163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.001163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.001163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.001163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.001163] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 713.102204] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.102515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.102515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.104405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.105030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.107292] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.128824] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 713.341703] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6bf254fe-a02c-4c36-8f89-52a5a801f9b5: rpc.has_security_group_logging(os_id): False [ 713.359290] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.359290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.359290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.359290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.359439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.359545] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.359596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.359661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.359806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.359879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.360082] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.360194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.360250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.360394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.360465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.360829] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.360938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.360992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.361160] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.361235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.361319] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be updated. [ 713.437684] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.437837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.437837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.438140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.438314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.455046] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 713.478595] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6eb745b-f38e-4b8f-9261-fe65a6934037: rpc.has_security_group_logging(os_id): False [ 713.499585] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.499774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.499848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.500112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.500189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.500436] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.500541] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.500648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.500763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.500843] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.500932] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 is going to be updated. [ 713.589490] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.589664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.589734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.589986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.590343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.610221] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.625225] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: IN_PROGRESS for 2s [ 714.112823] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.113115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.113115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.113313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.113385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.113502] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 714.152916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.153144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.153215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.153432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.153924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.166038] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 714.905631] env[65678]: INFO networking_nsxv3.common.synchronization [req-49db2107-1248-425f-998b-a43bfe4f1103 req-e41c1343-4da7-45ef-975a-e45b6fd24a16 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 714.905631] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 714.905631] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.905631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.905631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.906152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.906152] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.906152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.906152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.906299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.906385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.906480] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.147266] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 715.147462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.147668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.147927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.148036] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.409595] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.409764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.409838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.410074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.410170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.410383] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.410483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.410545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.410715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.410809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.410875] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 715.442060] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.442060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.442060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.442060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.442060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.453438] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 715.471757] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 715.474606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.474606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.474606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.474606] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.640331] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: SUCCESS [ 715.641515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.653377] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.653377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.653377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.653377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.653791] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.653791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.653923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.654088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.654210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.654342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.654464] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.978330] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.978678] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.978678] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.978978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.979518] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.979518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.979518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.979779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.979942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.980127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.980292] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.157786] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.158247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.158402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.158746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.159093] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.159335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.159527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.159826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.159974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.160421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.160421] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.160517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.160604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.160787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.160999] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.161285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.161456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.161734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.161931] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.162251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.162469] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.177481] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 716.177749] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.177914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.178195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.178359] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.178450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.178515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.178663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.178744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.178825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.178913] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.482284] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.485267] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.485267] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.485267] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.485267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.485776] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.485776] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.594500] env[65678]: INFO networking_nsxv3.common.synchronization [req-17b0e6ef-dcbe-42f0-b5d2-ae267c4bfa9c req-3625e4c1-628f-4f4b-a310-1973e017866d tempest-ListServersNegativeTestJSON-1141148033 tempest-ListServersNegativeTestJSON-1141148033-project-member] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 716.594964] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 716.595711] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.595711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.595711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.595711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.595923] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.595982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.596039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.597026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.597026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.597026] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.669484] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393a6f14-3ce6-441b-a403-1993c47b58e3: rpc.has_security_group_logging(os_id): False [ 716.681547] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.681856] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.681856] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.682039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.682211] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.682376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.682376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.682614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.682802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.682920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.683059] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.683260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.683260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.683649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.683649] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.683649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.683649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.683959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.683959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.683959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.684169] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.690367] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.690533] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.690604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.690880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.691026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.691300] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.691460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.691506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.691681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.691800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.692033] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.692163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.692246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.692416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.692522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.693052] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.693052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.693052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.693201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.693273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.693388] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 716.775456] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.775713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.775788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.776076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.776288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.791940] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 716.988295] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6bf254fe-a02c-4c36-8f89-52a5a801f9b5: rpc.has_security_group_logging(os_id): False [ 717.009659] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.009828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.010030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.010260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.010260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.010474] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.010568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.010568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.010841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.010909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.011123] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.011325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.011325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.011426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.011520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.011847] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.012034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.012153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.012395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.012545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.012678] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be updated. [ 717.070067] env[65678]: INFO networking_nsxv3.common.synchronization [None req-7355b35d-aa47-4edb-8d79-e00b6867ebd1 None None] Enqueued Resource ID: b47e963b-64da-4de3-9097-7f374aefb75e with Priority: HIGHEST for action port [ 717.070540] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47e963b-64da-4de3-9097-7f374aefb75e with Priority: HIGHEST for action port [ 717.070924] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b47e963b-64da-4de3-9097-7f374aefb75e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.071200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b47e963b-64da-4de3-9097-7f374aefb75e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.071313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b47e963b-64da-4de3-9097-7f374aefb75e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.071637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b47e963b-64da-4de3-9097-7f374aefb75e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.071779] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47e963b-64da-4de3-9097-7f374aefb75e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.101378] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.101616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.101743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.102040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.102262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.103613] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.123992] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 717.187096] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d: rpc.has_security_group_logging(os_id): False [ 717.215930] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.216348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.216348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.216430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.216539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.216724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.216843] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.216915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.217161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.217284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.217529] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.217619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.217710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.218146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.218146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.218345] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.218497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.218583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.218746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.218829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.218924] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 717.289685] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.289869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.290023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.290322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.290559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.311354] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 717.463421] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 717.463593] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 deletion is rescheduled due to dependency. [ 717.463704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.574102] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b47e963b-64da-4de3-9097-7f374aefb75e [ 717.574419] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.574618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.574687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.574919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.575049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.575126] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b47e963b-64da-4de3-9097-7f374aefb75e already deleted. [ 717.575229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b47e963b-64da-4de3-9097-7f374aefb75e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.606093] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.109850] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.110187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.110187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.110335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.110397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.110496] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be updated. [ 718.142800] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.142800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.142992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.143128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.143280] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.153931] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 718.809208] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 718.811122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.140330] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 719.142104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.210912] env[65678]: INFO networking_nsxv3.common.synchronization [None req-83533d4c-0190-4c6c-b952-42c62c987876 None None] Enqueued Resource ID: e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c with Priority: HIGHEST for action port [ 719.211353] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c with Priority: HIGHEST for action port [ 719.212056] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.212056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.212304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.213452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.213576] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.324125] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 719.324357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.652257] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e3bb0ae0-8fe6-474c-a66a-bcf08a80cfae None None] Enqueued Resource ID: f878bebe-74b7-41eb-9bbf-0b109879028a with Priority: HIGHEST for action port [ 719.656275] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f878bebe-74b7-41eb-9bbf-0b109879028a with Priority: HIGHEST for action port [ 719.656275] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-f878bebe-74b7-41eb-9bbf-0b109879028a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.656275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f878bebe-74b7-41eb-9bbf-0b109879028a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.656275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f878bebe-74b7-41eb-9bbf-0b109879028a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.656486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f878bebe-74b7-41eb-9bbf-0b109879028a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.656550] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f878bebe-74b7-41eb-9bbf-0b109879028a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.682044] env[65678]: INFO networking_nsxv3.common.synchronization [req-02d6372c-c416-4b3f-bbbd-cbf25193e5b4 req-eb02ec37-ec70-4ee6-a362-855643c4280e tempest-FloatingIPsAssociationTestJSON-1218227649 tempest-FloatingIPsAssociationTestJSON-1218227649-project-member] Enqueued Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 719.682044] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGHEST for action security_group_members [ 719.682044] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.682044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.682044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.682459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.682720] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.683381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.683564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.683910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.684248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.684484] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.718087] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c [ 719.718366] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.718496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.718577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.720317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.720454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.720514] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c already deleted. [ 719.720974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1c5fcd2-f375-4c3b-b5fd-dcbd4605469c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.925026] env[65678]: INFO networking_nsxv3.common.synchronization [None req-c8660090-94b7-48dd-9868-080acc3c9236 None None] Enqueued Resource ID: 94372f4c-a16c-46ee-8f77-4a507fbe2646 with Priority: HIGHEST for action port [ 719.926024] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94372f4c-a16c-46ee-8f77-4a507fbe2646 with Priority: HIGHEST for action port [ 719.926225] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-94372f4c-a16c-46ee-8f77-4a507fbe2646 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.926344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94372f4c-a16c-46ee-8f77-4a507fbe2646" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.926822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94372f4c-a16c-46ee-8f77-4a507fbe2646" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.926822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94372f4c-a16c-46ee-8f77-4a507fbe2646" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.926822] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94372f4c-a16c-46ee-8f77-4a507fbe2646',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.161711] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f878bebe-74b7-41eb-9bbf-0b109879028a [ 720.161711] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.161711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.161711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.161711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.162197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.162197] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f878bebe-74b7-41eb-9bbf-0b109879028a already deleted. [ 720.162996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f878bebe-74b7-41eb-9bbf-0b109879028a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.164833] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 720.165042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.187312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.187467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.187467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.187704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.187770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.187942] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.188675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.188794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.188976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.190434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.190434] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9497cc12-615a-4090-934d-a1b00059825f is going to be updated. [ 720.217799] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.217799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.217799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.217946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.218113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.228241] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: IN_PROGRESS for 2s [ 720.432394] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94372f4c-a16c-46ee-8f77-4a507fbe2646 [ 720.432394] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.432394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.432394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.432394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.432394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.432394] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94372f4c-a16c-46ee-8f77-4a507fbe2646 already deleted. [ 720.432394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94372f4c-a16c-46ee-8f77-4a507fbe2646" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.721344] env[65678]: INFO networking_nsxv3.common.synchronization [None req-5aece797-44d2-4c19-8b6f-2181991cdf61 None None] Enqueued Resource ID: 9bfb6046-5630-416b-8c36-242d3405d88a with Priority: HIGHEST for action port [ 720.725085] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bfb6046-5630-416b-8c36-242d3405d88a with Priority: HIGHEST for action port [ 720.726287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bfb6046-5630-416b-8c36-242d3405d88a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.726530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bfb6046-5630-416b-8c36-242d3405d88a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.726530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bfb6046-5630-416b-8c36-242d3405d88a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.726795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bfb6046-5630-416b-8c36-242d3405d88a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.726880] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bfb6046-5630-416b-8c36-242d3405d88a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.235552] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bfb6046-5630-416b-8c36-242d3405d88a [ 721.235552] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.235552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.235552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.235552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.235552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.235552] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bfb6046-5630-416b-8c36-242d3405d88a already deleted. [ 721.235552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bfb6046-5630-416b-8c36-242d3405d88a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.242266] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: IN_PROGRESS for 4s [ 723.289378] env[65678]: INFO networking_nsxv3.common.synchronization [None req-9c0d1ca0-e191-4efd-bec4-ee0d830ba53b tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 723.290016] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 723.290352] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.290715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.290715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.292239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.292239] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.449337] env[65678]: INFO networking_nsxv3.common.synchronization [None req-77c8783a-5e64-44ea-b170-f75ce72c25d3 tempest-ServersV294TestFqdnHostnames-1719257474 tempest-ServersV294TestFqdnHostnames-1719257474-project-member] Enqueued Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_rules [ 723.450030] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_rules [ 723.450970] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.451831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.451831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.451831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.452087] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.454413] env[65678]: INFO networking_nsxv3.common.synchronization [None req-8d052c4e-134d-4ecc-96cc-570880aa8604 None None] Enqueued Resource ID: c24421dc-c89a-429b-91bf-1719f2cb36f4 with Priority: HIGHEST for action port [ 723.454810] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c24421dc-c89a-429b-91bf-1719f2cb36f4 with Priority: HIGHEST for action port [ 723.455180] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c24421dc-c89a-429b-91bf-1719f2cb36f4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.455351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c24421dc-c89a-429b-91bf-1719f2cb36f4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.455510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c24421dc-c89a-429b-91bf-1719f2cb36f4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.455949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c24421dc-c89a-429b-91bf-1719f2cb36f4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.455949] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c24421dc-c89a-429b-91bf-1719f2cb36f4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.537707] env[65678]: INFO networking_nsxv3.common.synchronization [None req-2b2475bf-3968-4fe1-80a4-0c2c84359ca0 tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 723.538299] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 723.538552] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.538654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.740570] env[65678]: INFO networking_nsxv3.common.synchronization [None req-a6c88c50-780e-4795-a422-9a612cb52dfb tempest-ServersV294TestFqdnHostnames-1719257474 tempest-ServersV294TestFqdnHostnames-1719257474-project-member] Enqueued Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_rules [ 723.741287] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_rules [ 723.741960] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.741960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.821179] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.821179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.821179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.821179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.821179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.821179] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 already deleted. [ 723.821179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.821179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.821179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.821179] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.959847] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c24421dc-c89a-429b-91bf-1719f2cb36f4 [ 723.960137] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.960412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.960412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.960563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.960633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.960741] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c24421dc-c89a-429b-91bf-1719f2cb36f4 already deleted. [ 723.960897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c24421dc-c89a-429b-91bf-1719f2cb36f4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.980491] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.980834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.980834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.980921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.981029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.981146] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc7f6218-60a3-4bd3-9819-6777964d3718 already deleted. [ 723.981231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.981385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.981549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.981634] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.061632] env[65678]: INFO networking_nsxv3.common.synchronization [None req-882bdceb-34c9-44e0-a09f-c265f852e7b6 tempest-AttachVolumeShelveTestJSON-1282061189 tempest-AttachVolumeShelveTestJSON-1282061189-project-member] Enqueued Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_rules [ 724.066024] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_rules [ 724.066024] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.066024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.066024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.066024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.066024] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.255273] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9497cc12-615a-4090-934d-a1b00059825f in Status: SUCCESS [ 724.255463] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9497cc12-615a-4090-934d-a1b00059825f deletion is rescheduled due to dependency. [ 724.255596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.342424] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.342808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.342808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.342808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.342923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.343716] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 already deleted. [ 724.343716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.509244] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.509536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.509536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.509747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.509747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.509859] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc7f6218-60a3-4bd3-9819-6777964d3718 already deleted. [ 724.509919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.585918] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.585918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.585918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.586528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.586528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.586528] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 already deleted. [ 724.586668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.721820] env[65678]: INFO networking_nsxv3.common.synchronization [None req-2950aef7-1202-4dba-815b-361b1e98c7ba tempest-AttachVolumeShelveTestJSON-1282061189 tempest-AttachVolumeShelveTestJSON-1282061189-project-member] Enqueued Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_rules [ 724.722667] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_rules [ 724.722667] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.722667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.722963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.723494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.723580] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.094154] env[65678]: INFO networking_nsxv3.common.synchronization [req-795dab17-7c30-496d-a201-9b6d6d79679d req-71be84b8-c757-414a-a400-13d7ccc85285 tempest-ServerRescueNegativeTestJSON-113281034 tempest-ServerRescueNegativeTestJSON-113281034-project-member] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 725.095349] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 725.095790] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.096655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.096837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.097199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.097409] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.097553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.097637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.097839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.097971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.098917] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.246248] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.246344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.246457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.246620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.246739] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.246809] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 already deleted. [ 725.246889] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.489362] env[65678]: INFO networking_nsxv3.common.synchronization [None req-af1f8c41-9712-4745-b6e2-e0d8a999cdfd None None] Enqueued Resource ID: 68f7816d-8ec9-4ca0-9a92-532cacb5c574 with Priority: HIGHEST for action port [ 725.489636] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f7816d-8ec9-4ca0-9a92-532cacb5c574 with Priority: HIGHEST for action port [ 725.490288] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f7816d-8ec9-4ca0-9a92-532cacb5c574 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.490415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f7816d-8ec9-4ca0-9a92-532cacb5c574" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.490484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f7816d-8ec9-4ca0-9a92-532cacb5c574" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.490954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f7816d-8ec9-4ca0-9a92-532cacb5c574" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.490954] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f7816d-8ec9-4ca0-9a92-532cacb5c574',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.600693] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.600893] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.601033] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.602579] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.602869] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.603045] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.603374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.603494] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.603528] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.603776] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.603875] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.603982] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.604100] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.604242] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.604329] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.604752] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.609585] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.609585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.609585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.609585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.609783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.609864] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.609959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.610920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.611146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.611237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.611479] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 already deleted. [ 725.611479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.631445] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.631658] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.631870] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.632404] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.632881] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-43e8f71f-ed18-4cf3-9414-e1016b769526 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.633170] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-43e8f71f-ed18-4cf3-9414-e1016b769526" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.633366] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-43e8f71f-ed18-4cf3-9414-e1016b769526" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.633820] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-43e8f71f-ed18-4cf3-9414-e1016b769526" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.634073] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43e8f71f-ed18-4cf3-9414-e1016b769526',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.807459] env[65678]: INFO networking_nsxv3.common.synchronization [None req-cf3416f3-6656-44f4-8814-0b72f71df1dd None None] Enqueued Resource ID: c4162cb0-ac91-48d6-b30f-5e61ff1bdedc with Priority: HIGHEST for action port [ 725.808038] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4162cb0-ac91-48d6-b30f-5e61ff1bdedc with Priority: HIGHEST for action port [ 725.808342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4162cb0-ac91-48d6-b30f-5e61ff1bdedc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.808698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4162cb0-ac91-48d6-b30f-5e61ff1bdedc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.808814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4162cb0-ac91-48d6-b30f-5e61ff1bdedc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.809125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4162cb0-ac91-48d6-b30f-5e61ff1bdedc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.809292] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4162cb0-ac91-48d6-b30f-5e61ff1bdedc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.992687] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68f7816d-8ec9-4ca0-9a92-532cacb5c574 [ 725.993090] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.993247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.993321] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.993522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.993616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.993717] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68f7816d-8ec9-4ca0-9a92-532cacb5c574 already deleted. [ 725.993799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f7816d-8ec9-4ca0-9a92-532cacb5c574" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.137885] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.138268] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.138475] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.138899] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.139168] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.139416] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 43e8f71f-ed18-4cf3-9414-e1016b769526 not found, creating... [ 726.139824] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.140299] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.140885] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.140885] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.141033] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.141442] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.141696] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.141878] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.142221] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.142435] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.142652] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 43e8f71f-ed18-4cf3-9414-e1016b769526 is going to be created. [ 726.166978] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.167226] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.167310] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.167583] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.167806] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.168040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-43e8f71f-ed18-4cf3-9414-e1016b769526" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.231960] env[65678]: INFO networking_nsxv3.common.synchronization [None req-7bc12bb5-baca-4db1-bc89-9b7a47d7a7e3 None None] Enqueued Resource ID: 459a969a-8d5b-45a1-b2ab-e3b18ec3dc66 with Priority: HIGHEST for action port [ 726.232293] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 459a969a-8d5b-45a1-b2ab-e3b18ec3dc66 with Priority: HIGHEST for action port [ 726.232985] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-459a969a-8d5b-45a1-b2ab-e3b18ec3dc66 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.233146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-459a969a-8d5b-45a1-b2ab-e3b18ec3dc66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.233224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-459a969a-8d5b-45a1-b2ab-e3b18ec3dc66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.234658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-459a969a-8d5b-45a1-b2ab-e3b18ec3dc66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.234658] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('459a969a-8d5b-45a1-b2ab-e3b18ec3dc66',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.312072] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4162cb0-ac91-48d6-b30f-5e61ff1bdedc [ 726.312204] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.312342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.312411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.312635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.312726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.312849] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4162cb0-ac91-48d6-b30f-5e61ff1bdedc already deleted. [ 726.312947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4162cb0-ac91-48d6-b30f-5e61ff1bdedc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.736014] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 459a969a-8d5b-45a1-b2ab-e3b18ec3dc66 [ 726.736401] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.736496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.736554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.737806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.737806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.737806] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:459a969a-8d5b-45a1-b2ab-e3b18ec3dc66 already deleted. [ 726.737806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-459a969a-8d5b-45a1-b2ab-e3b18ec3dc66" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.033798] env[65678]: INFO networking_nsxv3.common.synchronization [req-795dab17-7c30-496d-a201-9b6d6d79679d req-137e0a61-6e7d-46da-b059-16ee79107260 service nova] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_rules [ 727.033798] env[65678]: INFO networking_nsxv3.common.synchronization [req-795dab17-7c30-496d-a201-9b6d6d79679d req-137e0a61-6e7d-46da-b059-16ee79107260 service nova] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 727.033798] env[65678]: INFO networking_nsxv3.common.synchronization [req-795dab17-7c30-496d-a201-9b6d6d79679d req-137e0a61-6e7d-46da-b059-16ee79107260 service nova] Enqueued Resource ID: 43e8f71f-ed18-4cf3-9414-e1016b769526 with Priority: HIGHEST for action port [ 727.034259] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_rules [ 727.034390] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 727.034466] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43e8f71f-ed18-4cf3-9414-e1016b769526 with Priority: HIGHEST for action port [ 727.034756] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.034879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.034943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.035279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.035352] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.038067] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.038067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.038067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.038067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.038067] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.038067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.038067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.038067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.038067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.038067] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.038579] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-43e8f71f-ed18-4cf3-9414-e1016b769526 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.038640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43e8f71f-ed18-4cf3-9414-e1016b769526" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.038743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43e8f71f-ed18-4cf3-9414-e1016b769526" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.038835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43e8f71f-ed18-4cf3-9414-e1016b769526" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.038920] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43e8f71f-ed18-4cf3-9414-e1016b769526',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.067490] env[65678]: INFO networking_nsxv3.common.synchronization [req-33a3980d-8ba8-44b7-9530-300c2ffd4615 req-01a1aff9-b4b0-43ba-b8d3-e19d8f36d88c tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_members [ 727.068635] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGHEST for action security_group_members [ 727.068869] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433b7d9d-3978-4af8-a278-70a89b5d5f2e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.069009] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.069086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.069299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.069475] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.069594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.069658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.069874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.069947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.070120] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.448657] env[65678]: INFO networking_nsxv3.common.synchronization [req-d286df2f-654c-4d73-8a35-f9a9c2b9bf83 req-abef9bda-03c0-4890-9fa8-b837e1232ed1 tempest-ImagesNegativeTestJSON-526299197 tempest-ImagesNegativeTestJSON-526299197-project-member] Enqueued Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGHEST for action security_group_members [ 727.449125] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGHEST for action security_group_members [ 727.449459] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-32f35a35-0102-4d28-a65d-3999b6041978 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.449580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.449643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.450046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.450947] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.451224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.451224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.451986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.451986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.451986] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32f35a35-0102-4d28-a65d-3999b6041978',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.540251] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.541372] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.541713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.541838] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43e8f71f-ed18-4cf3-9414-e1016b769526 with status ACTIVE [ 727.541999] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.542350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.542440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.542638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.542733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.543864] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.544020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.544187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.544576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.544625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.544815] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.544916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.546551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.546748] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.546829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.547355] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43e8f71f-ed18-4cf3-9414-e1016b769526 is going to be updated. [ 727.571026] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.571026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.571026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.571239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.571275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.571434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43e8f71f-ed18-4cf3-9414-e1016b769526" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.581197] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.581467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.581542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.581790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.581938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.582245] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.582376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.582430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.582599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.582700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.582899] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e is going to be updated. [ 727.622023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.622187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.622313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.622508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.622656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.635566] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e in Status: IN_PROGRESS for 2s [ 727.955402] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.955930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.956112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.956395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.956531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.956773] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.957834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.957834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.957834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.957834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.957834] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32f35a35-0102-4d28-a65d-3999b6041978 already deleted. [ 727.957834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.988041] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-591 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.988041] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-591" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.988041] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-591" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.988814] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-591" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.990127] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.991894] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.995027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.995027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.995027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.995027] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.995027] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.995027] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.995027] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.995027] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.995027] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.995027] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.017908] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.018132] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.018275] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.019549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-591" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.019549] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-76840beb-4fe6-4195-ac66-54f31aeeddf1 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.019549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-76840beb-4fe6-4195-ac66-54f31aeeddf1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.019549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-76840beb-4fe6-4195-ac66-54f31aeeddf1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.019549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-76840beb-4fe6-4195-ac66-54f31aeeddf1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.019819] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76840beb-4fe6-4195-ac66-54f31aeeddf1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.043115] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.131015] env[65678]: INFO networking_nsxv3.common.synchronization [None req-31ea3f75-2ee2-4daf-9889-8f5da4b467e2 None None] Enqueued Resource ID: dd9726af-a699-445f-b48a-e2ddde64b78d with Priority: HIGHEST for action port [ 728.131440] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd9726af-a699-445f-b48a-e2ddde64b78d with Priority: HIGHEST for action port [ 728.132052] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd9726af-a699-445f-b48a-e2ddde64b78d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.132052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd9726af-a699-445f-b48a-e2ddde64b78d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.132052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd9726af-a699-445f-b48a-e2ddde64b78d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.132477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd9726af-a699-445f-b48a-e2ddde64b78d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.132477] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd9726af-a699-445f-b48a-e2ddde64b78d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.522697] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.523048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.523183] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.523507] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.523611] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.523768] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 76840beb-4fe6-4195-ac66-54f31aeeddf1 not found, creating... [ 728.524099] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.524259] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.524373] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.524592] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.524725] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.525110] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.525369] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.525614] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.525968] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.530193] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.530445] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 76840beb-4fe6-4195-ac66-54f31aeeddf1 is going to be created. [ 728.545892] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.546078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.546129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.546345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.546434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.546533] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 is going to be created. [ 728.556443] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.556769] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.556931] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.557293] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.557532] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.557755] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-76840beb-4fe6-4195-ac66-54f31aeeddf1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.573588] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.573790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.573790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.574119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.574301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.587663] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: UNINITIALIZED for 2s [ 728.634413] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd9726af-a699-445f-b48a-e2ddde64b78d [ 728.634746] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.634979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.635102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.635398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.635575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.635682] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd9726af-a699-445f-b48a-e2ddde64b78d already deleted. [ 728.635796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd9726af-a699-445f-b48a-e2ddde64b78d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.343758] env[65678]: INFO networking_nsxv3.common.synchronization [req-d286df2f-654c-4d73-8a35-f9a9c2b9bf83 req-6e894a33-97bb-48c4-8647-916860476555 service nova] Enqueued Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGHEST for action security_group_rules [ 729.344124] env[65678]: INFO networking_nsxv3.common.synchronization [req-d286df2f-654c-4d73-8a35-f9a9c2b9bf83 req-6e894a33-97bb-48c4-8647-916860476555 service nova] Enqueued Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGHEST for action security_group_members [ 729.344206] env[65678]: INFO networking_nsxv3.common.synchronization [req-d286df2f-654c-4d73-8a35-f9a9c2b9bf83 req-6e894a33-97bb-48c4-8647-916860476555 service nova] Enqueued Resource ID: 76840beb-4fe6-4195-ac66-54f31aeeddf1 with Priority: HIGHEST for action port [ 729.344803] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGHEST for action security_group_rules [ 729.344942] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGHEST for action security_group_members [ 729.347191] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76840beb-4fe6-4195-ac66-54f31aeeddf1 with Priority: HIGHEST for action port [ 729.347693] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32f35a35-0102-4d28-a65d-3999b6041978 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.347854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.347935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.348230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.349090] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32f35a35-0102-4d28-a65d-3999b6041978',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.349322] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-32f35a35-0102-4d28-a65d-3999b6041978 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.349478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.349586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.349730] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.349878] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.349972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.350043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.350185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.350271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.350358] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32f35a35-0102-4d28-a65d-3999b6041978',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.351415] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-76840beb-4fe6-4195-ac66-54f31aeeddf1 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.351523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76840beb-4fe6-4195-ac66-54f31aeeddf1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.351593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76840beb-4fe6-4195-ac66-54f31aeeddf1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.351743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76840beb-4fe6-4195-ac66-54f31aeeddf1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.351822] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76840beb-4fe6-4195-ac66-54f31aeeddf1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.648230] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e in Status: SUCCESS [ 729.648426] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e deletion is rescheduled due to dependency. [ 729.648540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.812811] env[65678]: INFO networking_nsxv3.common.synchronization [req-9967323c-f995-4b5b-9b57-aedd25d96396 req-89b9e0bd-0eda-48a7-98e9-939dc12ae291 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_members [ 729.813111] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_members [ 729.813488] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e857e4d2-27dd-462e-87df-ee44911ff684 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.813631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.813726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.814085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.814265] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.814403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.814466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.814647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.814750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.814866] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.854214] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-32f35a35-0102-4d28-a65d-3999b6041978 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.855522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.855522] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32f35a35-0102-4d28-a65d-3999b6041978',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.855522] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76840beb-4fe6-4195-ac66-54f31aeeddf1 with status ACTIVE [ 729.855694] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.855694] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.855795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.855952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.856063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.856413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.856413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.856413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.856540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.861344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.861344] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.861344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.861344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.861344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.861344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.861344] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76840beb-4fe6-4195-ac66-54f31aeeddf1 is going to be updated. [ 729.895202] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.895338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.895416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.895625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.895765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.895955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76840beb-4fe6-4195-ac66-54f31aeeddf1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.318437] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.318437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.318437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.318437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.318437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.318437] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.318437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.318437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.318437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.318437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.318437] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e857e4d2-27dd-462e-87df-ee44911ff684 already deleted. [ 730.318437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.340537] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.340872] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.341048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.341370] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.341663] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.342691] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.342886] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.343422] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.343709] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.343941] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.344180] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.344180] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.344284] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.344391] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.344493] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.344626] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.366254] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.366433] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.366568] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.366743] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.367370] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.367370] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.367370] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.367978] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.367978] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d523c0d0-7e86-4fdb-bca2-3f0d0409b98a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.368810] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32f35a35-0102-4d28-a65d-3999b6041978',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.598927] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: SUCCESS [ 730.599079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.599232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.599457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.599650] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.599769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.599834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.599986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.600089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.600174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.600264] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.873030] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.873030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.873030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.873030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.873030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.873030] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port d523c0d0-7e86-4fdb-bca2-3f0d0409b98a not found, creating... [ 730.873030] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.873030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.873030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.873030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.873030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.873620] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.873937] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.874328] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.874645] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.874968] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.875222] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: d523c0d0-7e86-4fdb-bca2-3f0d0409b98a is going to be created. [ 730.876997] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.877290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.877456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.877691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.877860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.878039] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32f35a35-0102-4d28-a65d-3999b6041978 is going to be created. [ 730.902198] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.902513] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.902513] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.903392] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.903392] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.903392] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.905888] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.906184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.906305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.906609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.906811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.919467] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32f35a35-0102-4d28-a65d-3999b6041978 in Status: UNINITIALIZED for 2s [ 731.103257] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.103455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.103509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.103700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.103940] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.104069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.104132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.104300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.104391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.104480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.104629] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.104721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.104782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.104928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.105083] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.105174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.105233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.105370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.105445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.105526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.105626] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.609272] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e72b3b22-43b8-43bc-86bc-e0360d10d8e5: rpc.has_security_group_logging(os_id): False [ 731.633731] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.634505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.634646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.635122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.635255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.635669] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.635810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.635888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.636124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.636304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.636567] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.636875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.639190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.639454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.639646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.639913] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.640040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.640107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.641112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.641217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.641325] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 is going to be created. [ 731.644684] env[65678]: INFO networking_nsxv3.common.synchronization [req-9967323c-f995-4b5b-9b57-aedd25d96396 req-37076f84-e493-45dd-868d-8acba18c5284 service nova] Enqueued Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_rules [ 731.644861] env[65678]: INFO networking_nsxv3.common.synchronization [req-9967323c-f995-4b5b-9b57-aedd25d96396 req-37076f84-e493-45dd-868d-8acba18c5284 service nova] Enqueued Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_members [ 731.644993] env[65678]: INFO networking_nsxv3.common.synchronization [req-9967323c-f995-4b5b-9b57-aedd25d96396 req-37076f84-e493-45dd-868d-8acba18c5284 service nova] Enqueued Resource ID: d523c0d0-7e86-4fdb-bca2-3f0d0409b98a with Priority: HIGHEST for action port [ 731.645629] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_rules [ 731.645770] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_members [ 731.645866] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d523c0d0-7e86-4fdb-bca2-3f0d0409b98a with Priority: HIGHEST for action port [ 731.646576] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e857e4d2-27dd-462e-87df-ee44911ff684 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.646723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.646810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.647036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.647111] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.649110] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e857e4d2-27dd-462e-87df-ee44911ff684 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.649242] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.649337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.650120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.653917] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.653917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.653917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.653917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.653917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.653917] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.653917] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.653917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.653917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.653917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.653917] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d523c0d0-7e86-4fdb-bca2-3f0d0409b98a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.723036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.723036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.723036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.723036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.723036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.736362] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: IN_PROGRESS for 2s [ 732.158028] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.158028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e857e4d2-27dd-462e-87df-ee44911ff684 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.158028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.158028] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d523c0d0-7e86-4fdb-bca2-3f0d0409b98a with status ACTIVE [ 732.158028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.158028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.158028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.158028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.158028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.158028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.158028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.158028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.158028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.158028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.158606] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.158606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.158606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.158606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.158606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.158606] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d523c0d0-7e86-4fdb-bca2-3f0d0409b98a is going to be updated. [ 732.183440] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.183731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.184349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.184349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.184349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.184752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d523c0d0-7e86-4fdb-bca2-3f0d0409b98a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.663560] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.931676] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32f35a35-0102-4d28-a65d-3999b6041978 in Status: SUCCESS [ 732.931922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.932102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.932328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.932523] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.932657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.932722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.932955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.933050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.933138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.933229] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32f35a35-0102-4d28-a65d-3999b6041978',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.948869] env[65678]: INFO networking_nsxv3.common.synchronization [req-578aba12-4815-45b6-bae0-49856e6d7bab req-2f360a31-8155-4c43-abf2-a65ee68d8c8b tempest-ServerRescueNegativeTestJSON-113281034 tempest-ServerRescueNegativeTestJSON-113281034-project-member] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 732.949308] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 732.949798] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.949941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.950041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.950436] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.950864] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.950987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.951303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.951303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.951392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.951460] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.169705] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.169705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.169705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.170605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.170605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.170605] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e857e4d2-27dd-462e-87df-ee44911ff684 is going to be created. [ 733.199830] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.199830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.199830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.199830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.199830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.211606] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e857e4d2-27dd-462e-87df-ee44911ff684 in Status: UNINITIALIZED for 2s [ 733.435781] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-32f35a35-0102-4d28-a65d-3999b6041978 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.435951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.436010] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.436242] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.436414] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.436563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.436563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.436726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.436829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.436933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.437101] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-32f35a35-0102-4d28-a65d-3999b6041978 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.437195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.437257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.437402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.437537] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.437626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.437686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.437851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.437936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.438919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.438919] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32f35a35-0102-4d28-a65d-3999b6041978',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.454042] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.601674] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.601855] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.601973] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.603693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.603693] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.603693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.603693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.603693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.603693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.603693] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.603693] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.604314] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.604314] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.604314] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.604314] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.604314] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.631020] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.631243] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.631390] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.631568] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.631976] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-621987f6-0736-4bb3-bdc7-4f077e72f05b taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.632235] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-621987f6-0736-4bb3-bdc7-4f077e72f05b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.632689] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-621987f6-0736-4bb3-bdc7-4f077e72f05b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.632689] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-621987f6-0736-4bb3-bdc7-4f077e72f05b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.632816] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('621987f6-0736-4bb3-bdc7-4f077e72f05b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.751362] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: SUCCESS [ 733.751362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.941243] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32f35a35-0102-4d28-a65d-3999b6041978: rpc.has_security_group_logging(os_id): False [ 733.963357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.963357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.963357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.963357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.964135] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.964135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.964135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.964135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.964135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.964135] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32f35a35-0102-4d28-a65d-3999b6041978 is going to be created. [ 733.965489] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.041141] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.043024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.043024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.043024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.043024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.056872] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32f35a35-0102-4d28-a65d-3999b6041978 in Status: IN_PROGRESS for 2s [ 734.137715] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.138203] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.138203] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.138832] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.138832] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.138832] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 621987f6-0736-4bb3-bdc7-4f077e72f05b not found, creating... [ 734.138988] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.139064] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.139179] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.139484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.139564] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.140348] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.140348] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.140348] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.140520] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.140745] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.140862] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 621987f6-0736-4bb3-bdc7-4f077e72f05b is going to be created. [ 734.181016] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.181205] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.181311] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.181635] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.181901] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.182116] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-621987f6-0736-4bb3-bdc7-4f077e72f05b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.470146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.470146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.470146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.470146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.470146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.470146] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 is going to be updated. [ 734.500194] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.500194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.500366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.500441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.500624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.514725] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: IN_PROGRESS for 2s [ 734.946561] env[65678]: INFO networking_nsxv3.common.synchronization [req-578aba12-4815-45b6-bae0-49856e6d7bab req-ee15b7df-e761-4529-bf3a-70da60c5b38e service nova] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_rules [ 734.946812] env[65678]: INFO networking_nsxv3.common.synchronization [req-578aba12-4815-45b6-bae0-49856e6d7bab req-ee15b7df-e761-4529-bf3a-70da60c5b38e service nova] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 734.947118] env[65678]: INFO networking_nsxv3.common.synchronization [req-578aba12-4815-45b6-bae0-49856e6d7bab req-ee15b7df-e761-4529-bf3a-70da60c5b38e service nova] Enqueued Resource ID: 621987f6-0736-4bb3-bdc7-4f077e72f05b with Priority: HIGHEST for action port [ 734.948341] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_rules [ 734.948630] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 734.948746] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621987f6-0736-4bb3-bdc7-4f077e72f05b with Priority: HIGHEST for action port [ 734.949082] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.949235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.949353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.949508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.949600] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.951014] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.951126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.951349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-621987f6-0736-4bb3-bdc7-4f077e72f05b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.951453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-621987f6-0736-4bb3-bdc7-4f077e72f05b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.951527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-621987f6-0736-4bb3-bdc7-4f077e72f05b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.951709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-621987f6-0736-4bb3-bdc7-4f077e72f05b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.951785] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('621987f6-0736-4bb3-bdc7-4f077e72f05b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.222201] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e857e4d2-27dd-462e-87df-ee44911ff684 in Status: SUCCESS [ 735.222201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.222201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.222201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.222201] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.222201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.222201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.222201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.222201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.222201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.222611] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.451677] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.451677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.454581] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 621987f6-0736-4bb3-bdc7-4f077e72f05b with status ACTIVE [ 735.454767] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.454875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.454944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.455231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.455328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.455501] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.455597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.455658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.455812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.455888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.456074] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.456166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.456223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.456361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.456434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.456531] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 621987f6-0736-4bb3-bdc7-4f077e72f05b is going to be updated. [ 735.480981] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.481220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.481220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.481407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.481540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.481713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-621987f6-0736-4bb3-bdc7-4f077e72f05b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.732381] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.024566] env[65678]: INFO networking_nsxv3.common.synchronization [req-1240d55d-0e9d-4b7d-81ae-2eed70b1e0d9 req-119d34e3-c447-4ffc-bfea-925cdcedcfaa tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 736.026572] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 736.028214] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.028214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.028214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.028214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.028214] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.028214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.028738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.030575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.030575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.030575] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.073352] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32f35a35-0102-4d28-a65d-3999b6041978 in Status: SUCCESS [ 736.073352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.234254] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e857e4d2-27dd-462e-87df-ee44911ff684: rpc.has_security_group_logging(os_id): False [ 736.253509] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.253692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.253758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.254025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.254196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.254457] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.254562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.254628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.254796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.254875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.254959] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e857e4d2-27dd-462e-87df-ee44911ff684 is going to be created. [ 736.332189] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.332189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.332189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.332375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.332427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.347514] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e857e4d2-27dd-462e-87df-ee44911ff684 in Status: IN_PROGRESS for 2s [ 736.525556] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: SUCCESS [ 736.525768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.525939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.526183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.526375] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.526492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.526559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.529925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.529925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.529925] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.534315] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.534315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.534315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.534315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.534315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.534315] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.534315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.534315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.534315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.534315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.534315] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d86ff68-550b-40c3-8567-854372ec34de already deleted. [ 736.534315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.019711] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.019929] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.020108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.020425] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.020762] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.020892] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.021050] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.021299] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.022907] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.023254] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.023676] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.023676] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.023830] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.024329] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.024329] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.024329] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.032256] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.046178] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.046345] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.046456] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.046626] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.047039] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-06c8198c-c9e5-4db1-879a-86018daff312 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.047181] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-06c8198c-c9e5-4db1-879a-86018daff312" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.047255] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-06c8198c-c9e5-4db1-879a-86018daff312" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.047693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-06c8198c-c9e5-4db1-879a-86018daff312" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.047693] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06c8198c-c9e5-4db1-879a-86018daff312',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.429858] env[65678]: INFO networking_nsxv3.common.synchronization [None req-19cb2f47-267d-4a5a-b903-19ac1788c9dc None None] Enqueued Resource ID: 3a8b850d-ed4c-48d9-ab37-d41d69966ff7 with Priority: HIGHEST for action port [ 737.430405] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a8b850d-ed4c-48d9-ab37-d41d69966ff7 with Priority: HIGHEST for action port [ 737.431036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a8b850d-ed4c-48d9-ab37-d41d69966ff7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.431472] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a8b850d-ed4c-48d9-ab37-d41d69966ff7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.431557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a8b850d-ed4c-48d9-ab37-d41d69966ff7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.431830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a8b850d-ed4c-48d9-ab37-d41d69966ff7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.431923] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a8b850d-ed4c-48d9-ab37-d41d69966ff7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.534432] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.551287] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.551641] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.551895] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.552333] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.552586] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.552909] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 06c8198c-c9e5-4db1-879a-86018daff312 not found, creating... [ 737.553365] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.553642] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.553844] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.554386] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.554634] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.555139] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.555394] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.555608] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.555944] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.556189] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.556417] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 06c8198c-c9e5-4db1-879a-86018daff312 is going to be created. [ 737.582404] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.582726] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.582928] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.583358] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.583719] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.584011] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-06c8198c-c9e5-4db1-879a-86018daff312" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.934047] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a8b850d-ed4c-48d9-ab37-d41d69966ff7 [ 737.934426] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.934426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.934569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.934713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.934865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.935034] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a8b850d-ed4c-48d9-ab37-d41d69966ff7 already deleted. [ 737.935175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a8b850d-ed4c-48d9-ab37-d41d69966ff7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.040633] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.040633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.040633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.040633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.040633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.040633] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 is going to be updated. [ 738.072713] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.072713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.072713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.072713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.072713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.083148] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: IN_PROGRESS for 2s [ 738.326842] env[65678]: INFO networking_nsxv3.common.synchronization [req-1240d55d-0e9d-4b7d-81ae-2eed70b1e0d9 req-164d2d2e-cec0-4a3c-b4ce-60127163c4ba service nova] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_rules [ 738.326842] env[65678]: INFO networking_nsxv3.common.synchronization [req-1240d55d-0e9d-4b7d-81ae-2eed70b1e0d9 req-164d2d2e-cec0-4a3c-b4ce-60127163c4ba service nova] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 738.326842] env[65678]: INFO networking_nsxv3.common.synchronization [req-1240d55d-0e9d-4b7d-81ae-2eed70b1e0d9 req-164d2d2e-cec0-4a3c-b4ce-60127163c4ba service nova] Enqueued Resource ID: 06c8198c-c9e5-4db1-879a-86018daff312 with Priority: HIGHEST for action port [ 738.327216] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_rules [ 738.327216] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 738.327216] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06c8198c-c9e5-4db1-879a-86018daff312 with Priority: HIGHEST for action port [ 738.327969] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.328179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.328313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.328888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.328986] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.330030] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.330030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.330211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.330303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.330466] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.330620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.330850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.331044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.331111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.331205] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.333275] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-06c8198c-c9e5-4db1-879a-86018daff312 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.333420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06c8198c-c9e5-4db1-879a-86018daff312" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.333486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06c8198c-c9e5-4db1-879a-86018daff312" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.333601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06c8198c-c9e5-4db1-879a-86018daff312" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.333701] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06c8198c-c9e5-4db1-879a-86018daff312',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.364316] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e857e4d2-27dd-462e-87df-ee44911ff684 in Status: SUCCESS [ 738.364687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.835938] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.835938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.838301] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06c8198c-c9e5-4db1-879a-86018daff312 with status ACTIVE [ 738.842021] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.842021] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.842021] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.842021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.842021] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06c8198c-c9e5-4db1-879a-86018daff312 is going to be updated. [ 738.842740] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.863192] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.863767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.863878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.864085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.864651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.864651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06c8198c-c9e5-4db1-879a-86018daff312" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.244035] env[65678]: INFO networking_nsxv3.common.synchronization [None req-20465d46-1ee9-473a-b225-b2eed9e5c967 None None] Enqueued Resource ID: 73c24924-3bcd-40c3-8274-6150d59f142e with Priority: HIGHEST for action port [ 739.244383] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73c24924-3bcd-40c3-8274-6150d59f142e with Priority: HIGHEST for action port [ 739.244982] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-73c24924-3bcd-40c3-8274-6150d59f142e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.244982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73c24924-3bcd-40c3-8274-6150d59f142e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.244982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73c24924-3bcd-40c3-8274-6150d59f142e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.247038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73c24924-3bcd-40c3-8274-6150d59f142e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.247276] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c24924-3bcd-40c3-8274-6150d59f142e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.347550] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.751687] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73c24924-3bcd-40c3-8274-6150d59f142e [ 739.752247] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.752591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.753157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.753587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.753767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.753949] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73c24924-3bcd-40c3-8274-6150d59f142e already deleted. [ 739.754239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73c24924-3bcd-40c3-8274-6150d59f142e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.850182] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.850387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.850434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.852044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.852044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.852044] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d86ff68-550b-40c3-8567-854372ec34de is going to be created. [ 739.878716] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.879573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.879573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.879573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.879573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.897466] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: UNINITIALIZED for 2s [ 740.097219] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: SUCCESS [ 740.097219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.097219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.097219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.097219] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.097219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.097219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.097703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.097703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.097703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.097703] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.110406] env[65678]: INFO networking_nsxv3.common.synchronization [req-2f8e9b7e-2807-4649-a860-24add4a165ad req-f790925e-15af-4724-aef9-51a7fe84f8a3 tempest-MigrationsAdminTest-513313397 tempest-MigrationsAdminTest-513313397-project-member] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 740.111726] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 740.111726] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.111726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.111726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.111726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.111726] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.111726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.112119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.112119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.112119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.112119] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.601092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.601092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.601092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.601092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.601092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.601092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.601092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.601092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.601092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.601092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.601735] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.601735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.601735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.601735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.601735] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.601735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.601735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.601962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.601962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.602032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.602675] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.614441] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.626841] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.627397] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.627548] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.627831] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.628161] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.628381] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.628527] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.630380] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.630380] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.630380] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.630380] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.630380] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.630380] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.630380] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.630380] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.630380] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.654165] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.654641] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.654955] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.655341] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.655877] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-42c4046f-64da-4043-9922-b04fb2cf32ce taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.657019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-42c4046f-64da-4043-9922-b04fb2cf32ce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.657019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-42c4046f-64da-4043-9922-b04fb2cf32ce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.657019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-42c4046f-64da-4043-9922-b04fb2cf32ce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.657345] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42c4046f-64da-4043-9922-b04fb2cf32ce',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.106431] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e72b3b22-43b8-43bc-86bc-e0360d10d8e5: rpc.has_security_group_logging(os_id): False [ 741.117164] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.124332] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.124504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.124554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.125156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.125295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.125495] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.125612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.125677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.125839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.125916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.126115] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.126210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.126271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.126409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.126481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.126672] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.126764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.126824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.126961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.127045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.127135] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 is going to be updated. [ 741.159982] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.160218] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.160321] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.160597] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.160775] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.160931] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 42c4046f-64da-4043-9922-b04fb2cf32ce not found, creating... [ 741.161323] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.161486] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.161599] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.161828] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.161959] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.162253] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.162397] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.162507] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.162700] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.162854] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.162984] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 42c4046f-64da-4043-9922-b04fb2cf32ce is going to be created. [ 741.186619] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.186840] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.186988] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.187308] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.187528] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.187747] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-42c4046f-64da-4043-9922-b04fb2cf32ce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.197988] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.198340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.198340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.198620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.198783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.212373] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: IN_PROGRESS for 2s [ 741.620401] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.620847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.620847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.621081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.621210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.621383] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b is going to be updated. [ 741.661295] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.661533] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.661600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.661836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.661989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.673288] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: IN_PROGRESS for 2s [ 741.910844] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: SUCCESS [ 741.911096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.911275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.911503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.911698] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.911817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.911886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.912084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.912198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.912234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.912336] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.964240] env[65678]: INFO networking_nsxv3.common.synchronization [req-2f8e9b7e-2807-4649-a860-24add4a165ad req-26e334d9-c8ae-4e85-8443-59281419af94 service nova] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_rules [ 741.964647] env[65678]: INFO networking_nsxv3.common.synchronization [req-2f8e9b7e-2807-4649-a860-24add4a165ad req-26e334d9-c8ae-4e85-8443-59281419af94 service nova] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 741.964963] env[65678]: INFO networking_nsxv3.common.synchronization [req-2f8e9b7e-2807-4649-a860-24add4a165ad req-26e334d9-c8ae-4e85-8443-59281419af94 service nova] Enqueued Resource ID: 42c4046f-64da-4043-9922-b04fb2cf32ce with Priority: HIGHEST for action port [ 741.966106] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_rules [ 741.966357] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 741.967331] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42c4046f-64da-4043-9922-b04fb2cf32ce with Priority: HIGHEST for action port [ 741.968231] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.968632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.968975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.969213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.969387] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.973294] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.974801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.975067] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-42c4046f-64da-4043-9922-b04fb2cf32ce taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.975261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42c4046f-64da-4043-9922-b04fb2cf32ce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.975349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42c4046f-64da-4043-9922-b04fb2cf32ce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.977234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42c4046f-64da-4043-9922-b04fb2cf32ce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.977350] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42c4046f-64da-4043-9922-b04fb2cf32ce',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.097907] env[65678]: INFO networking_nsxv3.common.synchronization [None req-9dcbd497-e30b-422a-a519-81f553849553 None None] Enqueued Resource ID: 343d8c3f-afa6-413b-bc68-4c5770d25dd1 with Priority: HIGHEST for action port [ 742.097907] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 343d8c3f-afa6-413b-bc68-4c5770d25dd1 with Priority: HIGHEST for action port [ 742.097907] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-343d8c3f-afa6-413b-bc68-4c5770d25dd1 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.097907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-343d8c3f-afa6-413b-bc68-4c5770d25dd1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.097907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-343d8c3f-afa6-413b-bc68-4c5770d25dd1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.097907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-343d8c3f-afa6-413b-bc68-4c5770d25dd1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.097907] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('343d8c3f-afa6-413b-bc68-4c5770d25dd1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.416171] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.416171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.416306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.418031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.418031] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.418031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.418031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.418031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.418031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.418031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.418031] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.418031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.418031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.418031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.418450] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.418450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.418450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.418450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.418450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.418596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.419184] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.473791] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.473791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.480481] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42c4046f-64da-4043-9922-b04fb2cf32ce with status ACTIVE [ 742.480481] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.480656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.480656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.480868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.480868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.481047] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.481243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.481432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.481641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.481723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.482987] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.482987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.482987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.482987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.482987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.482987] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42c4046f-64da-4043-9922-b04fb2cf32ce is going to be updated. [ 742.507462] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.507605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.507681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.507892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.508035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.508197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42c4046f-64da-4043-9922-b04fb2cf32ce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.599951] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 343d8c3f-afa6-413b-bc68-4c5770d25dd1 [ 742.600226] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.600369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.600439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.600655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.600742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.600837] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:343d8c3f-afa6-413b-bc68-4c5770d25dd1 already deleted. [ 742.600928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-343d8c3f-afa6-413b-bc68-4c5770d25dd1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.925611] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d86ff68-550b-40c3-8567-854372ec34de: rpc.has_security_group_logging(os_id): False [ 742.945543] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.945685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.946812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.946812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.946812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.946812] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.946812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.946812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.946812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.946812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.946812] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.947195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.947195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.947195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.947195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.947351] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.947439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.947499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.947636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.947709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.947793] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d86ff68-550b-40c3-8567-854372ec34de is going to be created. [ 743.012774] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.015358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.015358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.015358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.015358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.026237] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: IN_PROGRESS for 2s [ 743.229855] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: SUCCESS [ 743.229855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.686754] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: SUCCESS [ 743.687087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.687336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.687655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.687935] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.689800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.689800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.689800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.689800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.689800] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.194439] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.698862] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.815971] env[65678]: INFO networking_nsxv3.common.synchronization [req-b467591d-d222-447d-924e-750b0229e9fd req-4df4874a-e3ab-42c0-8c2f-2fb6853cbcb3 tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 744.815971] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 744.815971] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.815971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.816346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.816719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.817064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.817945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.820277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.820277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.820277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.820277] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.044103] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: SUCCESS [ 745.044441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.204016] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.205676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.205676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.205676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.205676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.205676] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b is going to be updated. [ 745.236301] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.236967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.236967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.236967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.237086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.249549] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: IN_PROGRESS for 2s [ 745.272693] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.272693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.273281] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.273281] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.274440] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.274440] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.274440] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.274440] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.274440] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.274440] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.274803] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.274803] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.274803] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.274803] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.274936] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.275027] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.300142] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.300345] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.300504] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.301484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.301484] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-0ba29e5a-1367-476c-90ee-a0622cda2e1d taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.301484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-0ba29e5a-1367-476c-90ee-a0622cda2e1d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.301484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-0ba29e5a-1367-476c-90ee-a0622cda2e1d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.301680] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-0ba29e5a-1367-476c-90ee-a0622cda2e1d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.301680] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ba29e5a-1367-476c-90ee-a0622cda2e1d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.321668] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.321832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.321894] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.322103] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.323205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.323205] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.323205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.323205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.323205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.323205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.323205] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c already deleted. [ 745.323205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.439184] env[65678]: INFO networking_nsxv3.common.synchronization [None req-4cbfd1be-f4b6-41c4-a4a0-2dcbc81fdfc8 None None] Enqueued Resource ID: 07c3f288-6004-4f38-967c-7e17953a600e with Priority: HIGHEST for action port [ 745.441779] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07c3f288-6004-4f38-967c-7e17953a600e with Priority: HIGHEST for action port [ 745.441779] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-07c3f288-6004-4f38-967c-7e17953a600e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.441779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07c3f288-6004-4f38-967c-7e17953a600e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.441779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07c3f288-6004-4f38-967c-7e17953a600e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.441779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07c3f288-6004-4f38-967c-7e17953a600e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.441779] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07c3f288-6004-4f38-967c-7e17953a600e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.804458] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.804664] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.804757] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.805160] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.805347] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.805548] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 0ba29e5a-1367-476c-90ee-a0622cda2e1d not found, creating... [ 745.805735] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.805992] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.806144] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.806373] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.806505] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.806779] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.806928] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.807051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.807275] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.807520] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.807582] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 0ba29e5a-1367-476c-90ee-a0622cda2e1d is going to be created. [ 745.830224] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.830549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.830858] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.831287] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.831640] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.832068] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-0ba29e5a-1367-476c-90ee-a0622cda2e1d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.944639] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07c3f288-6004-4f38-967c-7e17953a600e [ 745.944639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.944639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.944639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.944639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.944639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.944639] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07c3f288-6004-4f38-967c-7e17953a600e already deleted. [ 745.944639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07c3f288-6004-4f38-967c-7e17953a600e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.557901] env[65678]: INFO networking_nsxv3.common.synchronization [req-b467591d-d222-447d-924e-750b0229e9fd req-fe97f6ba-b0b7-4843-9a7a-b746a3f7b0d7 service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 746.558322] env[65678]: INFO networking_nsxv3.common.synchronization [req-b467591d-d222-447d-924e-750b0229e9fd req-fe97f6ba-b0b7-4843-9a7a-b746a3f7b0d7 service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 746.558322] env[65678]: INFO networking_nsxv3.common.synchronization [req-b467591d-d222-447d-924e-750b0229e9fd req-fe97f6ba-b0b7-4843-9a7a-b746a3f7b0d7 service nova] Enqueued Resource ID: 0ba29e5a-1367-476c-90ee-a0622cda2e1d with Priority: HIGHEST for action port [ 746.558906] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 746.559147] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 746.559682] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba29e5a-1367-476c-90ee-a0622cda2e1d with Priority: HIGHEST for action port [ 746.559987] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.560172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.560439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.560724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.560826] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.562443] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.562528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.562528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.562727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.563082] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.563082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.563276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.563276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.563459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.563508] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.567253] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ba29e5a-1367-476c-90ee-a0622cda2e1d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.567253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ba29e5a-1367-476c-90ee-a0622cda2e1d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.567253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ba29e5a-1367-476c-90ee-a0622cda2e1d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.567253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ba29e5a-1367-476c-90ee-a0622cda2e1d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.567253] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ba29e5a-1367-476c-90ee-a0622cda2e1d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.066825] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.066953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.068302] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.069219] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ba29e5a-1367-476c-90ee-a0622cda2e1d with status ACTIVE [ 747.069417] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.069537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.069605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.069806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.069895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.070107] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.070221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.070316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.070437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.070477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.070647] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.070739] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.070842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.070983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.071109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.071202] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ba29e5a-1367-476c-90ee-a0622cda2e1d is going to be updated. [ 747.097198] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.097398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.097398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.097609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.097740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.097897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ba29e5a-1367-476c-90ee-a0622cda2e1d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.159426] env[65678]: INFO networking_nsxv3.common.synchronization [req-2df0a344-25cd-4c0c-a456-0aa3375d148e req-0bc8cdd3-a87c-49bb-b13b-696b045e5987 tempest-ImagesNegativeTestJSON-526299197 tempest-ImagesNegativeTestJSON-526299197-project-member] Enqueued Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGHEST for action security_group_members [ 747.160321] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGHEST for action security_group_members [ 747.160738] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-32f35a35-0102-4d28-a65d-3999b6041978 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.160904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.160997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.161246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.161494] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.161708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.161742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.161989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.162139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.162263] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32f35a35-0102-4d28-a65d-3999b6041978',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.264326] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: SUCCESS [ 747.264605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.264810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.265079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.265298] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.265443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.265510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.265675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.265756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.265841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.265931] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.573484] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.666283] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.666513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.666513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.667621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.667621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.667621] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.667621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.667621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.667621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.667621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.667621] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32f35a35-0102-4d28-a65d-3999b6041978 is going to be updated. [ 747.698900] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.699144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.699233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.700769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.701230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.716097] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32f35a35-0102-4d28-a65d-3999b6041978 in Status: IN_PROGRESS for 2s [ 747.769557] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.769753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.769812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.770041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.770208] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.770307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.770368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.770949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.770949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.770949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.770949] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.770949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.771168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.771168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.773019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.773019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.773019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.773019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.773019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.773019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.773019] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.080116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.080303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.080380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.080601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.080704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.080797] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be created. [ 748.124477] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.124477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.124663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.124904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.125186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.138056] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: UNINITIALIZED for 2s [ 748.275153] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb02d1eb-8ee4-47ad-b890-95d76e24df1b: rpc.has_security_group_logging(os_id): False [ 748.297051] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.297051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.297051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.297051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.297051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.297051] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.297051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.297051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.297051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.297051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.297449] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.297449] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.297449] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.297550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.297581] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.298740] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.298740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.298740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.298740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.298969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.298969] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b is going to be updated. [ 748.394752] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.394950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.395642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.395642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.395642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.422954] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: IN_PROGRESS for 2s [ 748.439645] env[65678]: INFO networking_nsxv3.common.synchronization [None req-a0fa0de9-7722-4e6a-ab54-e51066713234 None None] Enqueued Resource ID: f274a976-e8df-4c1b-ae97-7e4745b15f9f with Priority: HIGHEST for action port [ 748.440558] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f274a976-e8df-4c1b-ae97-7e4745b15f9f with Priority: HIGHEST for action port [ 748.441113] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-f274a976-e8df-4c1b-ae97-7e4745b15f9f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.441351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f274a976-e8df-4c1b-ae97-7e4745b15f9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.441499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f274a976-e8df-4c1b-ae97-7e4745b15f9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.442564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f274a976-e8df-4c1b-ae97-7e4745b15f9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.442772] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f274a976-e8df-4c1b-ae97-7e4745b15f9f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.945265] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f274a976-e8df-4c1b-ae97-7e4745b15f9f [ 748.945585] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.945646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.945680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.946993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.946993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.946993] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f274a976-e8df-4c1b-ae97-7e4745b15f9f already deleted. [ 748.946993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f274a976-e8df-4c1b-ae97-7e4745b15f9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.561169] env[65678]: INFO networking_nsxv3.common.synchronization [req-63056c7b-8819-4fd4-a07d-9e0e0c39d4c9 req-45488dd8-4413-4f80-908c-49a72348a588 tempest-ImagesOneServerTestJSON-224947826 tempest-ImagesOneServerTestJSON-224947826-project-member] Enqueued Resource ID: be3b7ec3-66f8-4175-9611-636d9a427a3e with Priority: HIGHEST for action security_group_members [ 749.561169] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be3b7ec3-66f8-4175-9611-636d9a427a3e with Priority: HIGHEST for action security_group_members [ 749.566287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be3b7ec3-66f8-4175-9611-636d9a427a3e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.566287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.566287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.566287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.566287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.566287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.566287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.566287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.566287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.566287] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be3b7ec3-66f8-4175-9611-636d9a427a3e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.727418] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32f35a35-0102-4d28-a65d-3999b6041978 in Status: SUCCESS [ 749.727627] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32f35a35-0102-4d28-a65d-3999b6041978 deletion is rescheduled due to dependency. [ 749.727748] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.070681] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.070681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.070681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.070681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.070681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.070681] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.070681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.070681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.070681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.070681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.070681] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be3b7ec3-66f8-4175-9611-636d9a427a3e is going to be updated. [ 750.079762] env[65678]: INFO networking_nsxv3.common.synchronization [req-c9920a7c-530f-485e-b324-58f1347ce6a5 req-b4205b38-f04d-4d0d-b248-23d6f1cc45ba tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 750.080495] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 750.080845] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.081097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.081864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.082163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.082350] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.082460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.082522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.082686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.082767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.082889] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.109539] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.109685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.109742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.110079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.110192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.129751] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be3b7ec3-66f8-4175-9611-636d9a427a3e in Status: IN_PROGRESS for 2s [ 750.151515] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 750.151808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.152040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.152303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.152534] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.152723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.153022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.153094] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.153210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.153750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.153906] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.437249] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: SUCCESS [ 750.437490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.532721] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.533048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-856" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.533366] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-856" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.533778] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-856" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.534210] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.534955] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.534955] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.534955] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.534955] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.535316] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.535484] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.535652] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.535808] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.535910] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.536046] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.536186] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.557640] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.557640] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 750.557640] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.557640] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-856" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.557878] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-d347306e-123e-4b8f-953d-d2786a356d14 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.557954] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.558068] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.558426] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.558607] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d347306e-123e-4b8f-953d-d2786a356d14',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.587361] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.587567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.587636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.587850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.587945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.588157] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.588271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.588328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.588536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.588715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.588715] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 already deleted. [ 750.588838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.657135] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.657135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.657135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.657455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.657455] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.657559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.657559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.657882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.657882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.657882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.658816] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.658816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.658816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.658816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.658816] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.658816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.658816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.658816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.658816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.659204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.659204] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.064423] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.064688] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.064812] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.065129] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.065277] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.065421] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port d347306e-123e-4b8f-953d-d2786a356d14 not found, creating... [ 751.065683] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.065838] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.065982] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.066230] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.066372] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.066720] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.067119] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.067119] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.067345] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.067478] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.067616] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: d347306e-123e-4b8f-953d-d2786a356d14 is going to be created. [ 751.097431] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.097845] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.097845] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.098679] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.098679] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.098847] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.164037] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c: rpc.has_security_group_logging(os_id): False [ 751.186596] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.186759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.186759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.187067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.187067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.187325] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.187427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.187919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.187919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.187919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.190724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.192287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.192602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.192737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.192872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.195596] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.195751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.195751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.195962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.196087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.196162] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be created. [ 751.201751] env[65678]: INFO networking_nsxv3.common.synchronization [None req-75dced95-7526-49c3-a0cc-85f9a7e158ff None None] Enqueued Resource ID: d372f374-df32-4710-8b1e-c75c6976fbf5 with Priority: HIGHEST for action port [ 751.205555] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d372f374-df32-4710-8b1e-c75c6976fbf5 with Priority: HIGHEST for action port [ 751.205555] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d372f374-df32-4710-8b1e-c75c6976fbf5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.205555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d372f374-df32-4710-8b1e-c75c6976fbf5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.205555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d372f374-df32-4710-8b1e-c75c6976fbf5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.205906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d372f374-df32-4710-8b1e-c75c6976fbf5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.205906] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d372f374-df32-4710-8b1e-c75c6976fbf5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.298916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.299174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.299320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.300563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.300786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.315552] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 751.710062] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d372f374-df32-4710-8b1e-c75c6976fbf5 [ 751.710062] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.710062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.710062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.710062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.710062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.710062] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d372f374-df32-4710-8b1e-c75c6976fbf5 already deleted. [ 751.710062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d372f374-df32-4710-8b1e-c75c6976fbf5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.888717] env[65678]: INFO networking_nsxv3.common.synchronization [req-c9920a7c-530f-485e-b324-58f1347ce6a5 req-23ba02ad-56fd-4a3b-b6c0-876855104abc service nova] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 751.888903] env[65678]: INFO networking_nsxv3.common.synchronization [req-c9920a7c-530f-485e-b324-58f1347ce6a5 req-23ba02ad-56fd-4a3b-b6c0-876855104abc service nova] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 751.889051] env[65678]: INFO networking_nsxv3.common.synchronization [req-c9920a7c-530f-485e-b324-58f1347ce6a5 req-23ba02ad-56fd-4a3b-b6c0-876855104abc service nova] Enqueued Resource ID: d347306e-123e-4b8f-953d-d2786a356d14 with Priority: HIGHEST for action port [ 751.889594] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 751.889760] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 751.889898] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d347306e-123e-4b8f-953d-d2786a356d14 with Priority: HIGHEST for action port [ 751.890275] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.890432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.890523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.890792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.890924] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.891916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.892071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.892169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.892401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.892557] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.892680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.892761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.892976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.893119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.893260] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.894505] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d347306e-123e-4b8f-953d-d2786a356d14 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.894505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.894505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.894801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.894917] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d347306e-123e-4b8f-953d-d2786a356d14',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.142447] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be3b7ec3-66f8-4175-9611-636d9a427a3e in Status: SUCCESS [ 752.143731] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be3b7ec3-66f8-4175-9611-636d9a427a3e deletion is rescheduled due to dependency. [ 752.143731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be3b7ec3-66f8-4175-9611-636d9a427a3e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.397735] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.397877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.399120] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.399651] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d347306e-123e-4b8f-953d-d2786a356d14 with status ACTIVE [ 752.399844] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.399960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.400043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.401845] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.401845] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.401845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.401845] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d347306e-123e-4b8f-953d-d2786a356d14 is going to be updated. [ 752.425218] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.425404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.425459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.425896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.425896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.426076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.589890] env[65678]: INFO networking_nsxv3.common.synchronization [req-dc0062e4-0862-4ff0-9bd0-a3b116015c5b req-5f098a2a-c60c-455e-983f-7fe5823b11e5 tempest-ServersV294TestFqdnHostnames-1719257474 tempest-ServersV294TestFqdnHostnames-1719257474-project-member] Enqueued Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_members [ 752.590418] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_members [ 752.591010] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.591171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.591460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.592048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.593072] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.593072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.593072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.593416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.593702] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.593867] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.796349] env[65678]: INFO networking_nsxv3.common.synchronization [None req-8e9ccda0-c6fc-4785-b29b-de34f9f76dc9 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_rules [ 752.796720] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_rules [ 752.799162] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d196335c-3d4b-49d3-91d2-49ab0c720654 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.801442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.801442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.801442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.801442] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.900167] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.010190] env[65678]: INFO networking_nsxv3.common.synchronization [None req-5c6023ea-bc46-4dff-abd9-4db23a383ab3 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_rules [ 753.010190] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_rules [ 753.010190] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d196335c-3d4b-49d3-91d2-49ab0c720654 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.010190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.063017] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-532 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.063017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-532" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.063017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-532" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.063017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-532" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.063017] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.063017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.063603] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.063933] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.064204] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.064502] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.064703] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.064910] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.065124] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.065323] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.065510] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.065720] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.086836] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.088606] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.088888] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.089190] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-532" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.089598] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-38d718b4-c620-45c9-a6d2-2a834628c763 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.091288] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-38d718b4-c620-45c9-a6d2-2a834628c763" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.091288] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-38d718b4-c620-45c9-a6d2-2a834628c763" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.091288] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-38d718b4-c620-45c9-a6d2-2a834628c763" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.091288] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38d718b4-c620-45c9-a6d2-2a834628c763',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.096861] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.097227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.097227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.097323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.097368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.097567] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.097665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.097730] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.097876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.097954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.098078] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7f6218-60a3-4bd3-9819-6777964d3718 already deleted. [ 753.098164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.333790] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.334315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.334315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.334315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.334591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.334591] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d196335c-3d4b-49d3-91d2-49ab0c720654 already deleted. [ 753.334591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.334751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.334892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.334983] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.337742] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 753.338612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.405509] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.405805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.405872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.406181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.406311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.406497] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 is going to be created. [ 753.446207] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.446797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.446797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.447023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.447129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.458970] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: UNINITIALIZED for 2s [ 753.595714] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.595977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.596193] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.596617] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.596752] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.596934] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 38d718b4-c620-45c9-a6d2-2a834628c763 not found, creating... [ 753.597329] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.597532] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.597665] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.598071] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.598327] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.598651] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.598813] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.598927] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.599169] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.599309] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.599447] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 38d718b4-c620-45c9-a6d2-2a834628c763 is going to be created. [ 753.624085] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.624299] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.624465] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.624702] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.624923] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.625352] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-38d718b4-c620-45c9-a6d2-2a834628c763" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.859917] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.860163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.860261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.860531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.860653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.860820] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d196335c-3d4b-49d3-91d2-49ab0c720654 already deleted. [ 753.860957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.360572] env[65678]: INFO networking_nsxv3.common.synchronization [req-dc0062e4-0862-4ff0-9bd0-a3b116015c5b req-cfacced7-4b31-419a-a8cf-2a5c51d916e9 service nova] Enqueued Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_rules [ 754.361149] env[65678]: INFO networking_nsxv3.common.synchronization [req-dc0062e4-0862-4ff0-9bd0-a3b116015c5b req-cfacced7-4b31-419a-a8cf-2a5c51d916e9 service nova] Enqueued Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_members [ 754.361149] env[65678]: INFO networking_nsxv3.common.synchronization [req-dc0062e4-0862-4ff0-9bd0-a3b116015c5b req-cfacced7-4b31-419a-a8cf-2a5c51d916e9 service nova] Enqueued Resource ID: 38d718b4-c620-45c9-a6d2-2a834628c763 with Priority: HIGHEST for action port [ 754.361952] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_rules [ 754.361952] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_members [ 754.361952] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38d718b4-c620-45c9-a6d2-2a834628c763 with Priority: HIGHEST for action port [ 754.363419] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.364412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.364412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.364412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.364412] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.366506] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.366766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.366854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.367666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.367666] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.367666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.367873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.368210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.368210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.368272] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.369483] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-38d718b4-c620-45c9-a6d2-2a834628c763 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.369483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38d718b4-c620-45c9-a6d2-2a834628c763" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.369483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38d718b4-c620-45c9-a6d2-2a834628c763" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.369831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38d718b4-c620-45c9-a6d2-2a834628c763" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.369831] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38d718b4-c620-45c9-a6d2-2a834628c763',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.876265] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.876265] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.876265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.876265] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38d718b4-c620-45c9-a6d2-2a834628c763 with status ACTIVE [ 754.876265] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.876265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.876265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.876265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.876265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.876265] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.876265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.876265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.876265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.876265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.877276] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.877276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.880825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.883433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.883433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.883433] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38d718b4-c620-45c9-a6d2-2a834628c763 is going to be updated. [ 754.917734] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.918335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.918335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.918541] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.918851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.918851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38d718b4-c620-45c9-a6d2-2a834628c763" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.344412] env[65678]: INFO networking_nsxv3.common.synchronization [req-8c7e9f5c-3f0e-449b-854c-db1753528de4 req-04f531ac-4548-4391-80c1-ae9d6e60565a tempest-AttachVolumeShelveTestJSON-1282061189 tempest-AttachVolumeShelveTestJSON-1282061189-project-member] Enqueued Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_members [ 755.344969] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_members [ 755.345304] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.345480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.345534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.346151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.346151] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.346151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.346151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.346430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.346430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.346430] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.385622] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.478731] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: SUCCESS [ 755.479524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.479644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.479804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.480015] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.480135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.480196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.480382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.480467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.480977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.480977] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.849697] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.849859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.849938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.850231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.850787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.850787] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.850787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.851000] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.851061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.851733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.851733] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 already deleted. [ 755.851733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.891075] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.891244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.891354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.891698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.891781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.891932] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7f6218-60a3-4bd3-9819-6777964d3718 is going to be created. [ 755.900945] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-544 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.901399] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.902039] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.903103] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.903599] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.903830] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.904409] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.904409] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.904487] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.904752] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.904907] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.905051] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.905160] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.905904] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.906080] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.906271] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.944373] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.944373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.944373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.944373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.944661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.946629] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.946822] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.947023] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.947193] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.947483] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-6c02b558-4061-4814-87d2-971e99c2bcce taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.947636] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.947802] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.948416] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.948416] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c02b558-4061-4814-87d2-971e99c2bcce',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.965729] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7f6218-60a3-4bd3-9819-6777964d3718 in Status: UNINITIALIZED for 2s [ 755.983254] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.450681] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.451172] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.451329] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.451713] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.451916] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.452094] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 6c02b558-4061-4814-87d2-971e99c2bcce not found, creating... [ 756.452393] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.452586] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.452707] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.453226] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.453553] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.454710] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.454710] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.454710] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.454710] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.454710] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.455039] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 6c02b558-4061-4814-87d2-971e99c2bcce is going to be created. [ 756.486280] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d6db365-2384-4e4f-98b7-13262fcd05f8: rpc.has_security_group_logging(os_id): False [ 756.489348] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.489550] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.489746] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.490071] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.490318] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.490545] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.506426] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.506608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.506686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.506921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.507020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.507310] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.507427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.507484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.507670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.507754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.507846] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 is going to be created. [ 756.593307] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.593307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.593674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.593674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.593782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.610617] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: IN_PROGRESS for 2s [ 757.192326] env[65678]: INFO networking_nsxv3.common.synchronization [req-8c7e9f5c-3f0e-449b-854c-db1753528de4 req-8e44b4b6-6202-46f3-b3cf-cdd5c28efebc service nova] Enqueued Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_rules [ 757.192509] env[65678]: INFO networking_nsxv3.common.synchronization [req-8c7e9f5c-3f0e-449b-854c-db1753528de4 req-8e44b4b6-6202-46f3-b3cf-cdd5c28efebc service nova] Enqueued Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_members [ 757.192645] env[65678]: INFO networking_nsxv3.common.synchronization [req-8c7e9f5c-3f0e-449b-854c-db1753528de4 req-8e44b4b6-6202-46f3-b3cf-cdd5c28efebc service nova] Enqueued Resource ID: 6c02b558-4061-4814-87d2-971e99c2bcce with Priority: HIGHEST for action port [ 757.193239] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_rules [ 757.193378] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_members [ 757.193478] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c02b558-4061-4814-87d2-971e99c2bcce with Priority: HIGHEST for action port [ 757.193768] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.193908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.193996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.194339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.194428] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.196240] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.196240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.196240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.196240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.196434] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.196530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.196591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.196753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.196816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.196932] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.199959] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c02b558-4061-4814-87d2-971e99c2bcce taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.201256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.201256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.201256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.201256] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c02b558-4061-4814-87d2-971e99c2bcce',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.698930] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.698930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.702291] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.705315] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c02b558-4061-4814-87d2-971e99c2bcce with status ACTIVE [ 757.707019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.707019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.707019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.707019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.708686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.708934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.709135] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c02b558-4061-4814-87d2-971e99c2bcce is going to be updated. [ 757.746694] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.746977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.746977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.747236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.747412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.747628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.979618] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7f6218-60a3-4bd3-9819-6777964d3718 in Status: SUCCESS [ 757.979832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.980027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.980658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.982305] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.982305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.982305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.982305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.982305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.982305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.982305] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.206842] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.443078] env[65678]: INFO networking_nsxv3.common.synchronization [None req-7eb5bf2a-e911-4c46-a924-b5fc66cbf7ce None None] Enqueued Resource ID: be35d614-76b9-45fa-8676-3816b87b4665 with Priority: HIGHEST for action port [ 758.443667] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be35d614-76b9-45fa-8676-3816b87b4665 with Priority: HIGHEST for action port [ 758.444099] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-be35d614-76b9-45fa-8676-3816b87b4665 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.444196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be35d614-76b9-45fa-8676-3816b87b4665" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.444262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be35d614-76b9-45fa-8676-3816b87b4665" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.444553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be35d614-76b9-45fa-8676-3816b87b4665" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.445066] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be35d614-76b9-45fa-8676-3816b87b4665',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.486245] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.624617] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: SUCCESS [ 758.624860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.674709] env[65678]: INFO networking_nsxv3.common.synchronization [req-f71d514a-08a1-4e5b-a734-45b6fcd46c11 req-19be48c4-5136-47ca-afa9-cd1c5f1dfd98 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 758.675285] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 758.675639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.675887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.676299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.676626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.678343] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.678516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.678604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.678824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.678957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.679121] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.712551] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.712551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.712551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.712551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.712551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.712551] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 is going to be created. [ 758.739639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.739885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.739988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.740213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.740378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.750963] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: UNINITIALIZED for 2s [ 758.948087] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be35d614-76b9-45fa-8676-3816b87b4665 [ 758.949076] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.949076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.949076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.950360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.950360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.950360] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be35d614-76b9-45fa-8676-3816b87b4665 already deleted. [ 758.950360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be35d614-76b9-45fa-8676-3816b87b4665" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.989089] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc7f6218-60a3-4bd3-9819-6777964d3718: rpc.has_security_group_logging(os_id): False [ 759.010977] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.011205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.011282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.011552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.011609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.011896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.012028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.012100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.012274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.012357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.012450] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc7f6218-60a3-4bd3-9819-6777964d3718 is going to be created. [ 759.085779] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.085939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.086023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.086252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.086442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.098753] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc7f6218-60a3-4bd3-9819-6777964d3718 in Status: IN_PROGRESS for 2s [ 759.182422] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.182542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.182586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.182960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.182960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.183193] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.183278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.183278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.183443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.183523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.183601] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 already deleted. [ 759.183705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.287043] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-339 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.287299] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-339" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.287299] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-339" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.287729] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-339" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.288864] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.289278] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.289278] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.289577] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.289721] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.290059] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.290402] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.290402] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.290499] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.290649] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.290742] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.291051] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.339660] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.339660] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.339660] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.340150] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-339" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.340292] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-88326e18-2322-4046-aca8-2055933064c9 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.340486] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.340585] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.341277] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.341467] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88326e18-2322-4046-aca8-2055933064c9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.803159] env[65678]: INFO networking_nsxv3.common.synchronization [req-119a5664-b329-4f8d-98c4-e55a2b141f9c req-7f370512-fb14-4973-b886-c630d1a3d5ca tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 759.803159] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 759.803493] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.803559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.803590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.803778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.804472] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.804594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.804662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.804824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.804911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.805014] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.845064] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.845220] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.845332] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.845772] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.846698] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.846698] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 88326e18-2322-4046-aca8-2055933064c9 not found, creating... [ 759.846698] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.846698] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.846698] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.847017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.847017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.847140] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.847292] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.847406] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.848560] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.848560] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.848560] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 88326e18-2322-4046-aca8-2055933064c9 is going to be created. [ 759.869615] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.869851] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.869977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.870362] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.870590] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.870911] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.307624] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.307860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.307860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.308113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.308230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.308399] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.308503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.308567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.308728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.308804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.308892] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 760.340366] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.340366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.340366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.340584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.340709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.353205] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 760.585032] env[65678]: INFO networking_nsxv3.common.synchronization [req-f71d514a-08a1-4e5b-a734-45b6fcd46c11 req-eff711ee-eecb-497d-aacb-44d7312eb2d4 service nova] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_rules [ 760.585251] env[65678]: INFO networking_nsxv3.common.synchronization [req-f71d514a-08a1-4e5b-a734-45b6fcd46c11 req-eff711ee-eecb-497d-aacb-44d7312eb2d4 service nova] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 760.585388] env[65678]: INFO networking_nsxv3.common.synchronization [req-f71d514a-08a1-4e5b-a734-45b6fcd46c11 req-eff711ee-eecb-497d-aacb-44d7312eb2d4 service nova] Enqueued Resource ID: 88326e18-2322-4046-aca8-2055933064c9 with Priority: HIGHEST for action port [ 760.585998] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_rules [ 760.586172] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 760.586309] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88326e18-2322-4046-aca8-2055933064c9 with Priority: HIGHEST for action port [ 760.586887] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.587020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.587020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.587312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.587413] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.591515] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.591515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.591515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.591515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.591712] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.591712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.591789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.592345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.592485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.592582] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.593777] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-88326e18-2322-4046-aca8-2055933064c9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.593907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.595671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.595671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.595671] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88326e18-2322-4046-aca8-2055933064c9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.763237] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: SUCCESS [ 760.763548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.763757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.764038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.764284] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.764410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.764478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.764648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.764730] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.764816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.764909] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.098144] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.100832] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.100832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.100832] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88326e18-2322-4046-aca8-2055933064c9 with status ACTIVE [ 761.100832] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.100832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.100832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.101201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.101201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.101261] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.101388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.103494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.103494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.103494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.103696] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.103696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.103782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.104882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.104986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.105084] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88326e18-2322-4046-aca8-2055933064c9 is going to be updated. [ 761.123580] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc7f6218-60a3-4bd3-9819-6777964d3718 in Status: SUCCESS [ 761.123580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.128646] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.128865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.128865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.129200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.129348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.130659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.268528] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.607626] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.642407] env[65678]: INFO networking_nsxv3.common.synchronization [None req-cc849f5e-7800-4bf1-8844-86ed1ad6aff1 None None] Enqueued Resource ID: 088c9081-4c42-483d-af7d-b604f7593379 with Priority: HIGHEST for action port [ 761.643206] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 088c9081-4c42-483d-af7d-b604f7593379 with Priority: HIGHEST for action port [ 761.644035] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-088c9081-4c42-483d-af7d-b604f7593379 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.644187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-088c9081-4c42-483d-af7d-b604f7593379" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.644298] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-088c9081-4c42-483d-af7d-b604f7593379" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.644639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-088c9081-4c42-483d-af7d-b604f7593379" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.644756] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('088c9081-4c42-483d-af7d-b604f7593379',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.773427] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ad6310b-73d1-441e-897d-b412b1e437a2: rpc.has_security_group_logging(os_id): False [ 761.798037] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.798037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.798037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.798297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.798297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.798596] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.798596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.798596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.798985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.798985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.799795] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 is going to be created. [ 761.873756] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.874959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.874959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.874959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.874959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.887216] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: IN_PROGRESS for 2s [ 762.118637] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.118993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.118993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.119073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.119137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.119240] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be created. [ 762.148182] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 088c9081-4c42-483d-af7d-b604f7593379 [ 762.148182] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.148182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.148182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.148182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.148182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.148182] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:088c9081-4c42-483d-af7d-b604f7593379 already deleted. [ 762.148418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-088c9081-4c42-483d-af7d-b604f7593379" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.151968] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.152896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.152896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.152896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.152896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.163640] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: UNINITIALIZED for 2s [ 762.199645] env[65678]: INFO networking_nsxv3.common.synchronization [None req-038f4891-2df1-4cf3-938a-7fec21837d90 None None] Enqueued Resource ID: 0e51cca5-5f22-4764-9998-e958aea32fe2 with Priority: HIGHEST for action port [ 762.200270] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e51cca5-5f22-4764-9998-e958aea32fe2 with Priority: HIGHEST for action port [ 762.200410] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e51cca5-5f22-4764-9998-e958aea32fe2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.200842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e51cca5-5f22-4764-9998-e958aea32fe2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.200842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e51cca5-5f22-4764-9998-e958aea32fe2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.200945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e51cca5-5f22-4764-9998-e958aea32fe2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.200945] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e51cca5-5f22-4764-9998-e958aea32fe2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.369999] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 762.373269] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d deletion is rescheduled due to dependency. [ 762.373269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.704794] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e51cca5-5f22-4764-9998-e958aea32fe2 [ 762.710043] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.710043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.710043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.710043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.710043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.710043] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e51cca5-5f22-4764-9998-e958aea32fe2 already deleted. [ 762.710043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e51cca5-5f22-4764-9998-e958aea32fe2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.905425] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: SUCCESS [ 763.905425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.179037] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: SUCCESS [ 764.179486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.179629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.179834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.180049] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.180573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.180573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.180573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.180573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.180573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.180774] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.685364] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.685364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.685364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.685364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.685364] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.685364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.685364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.686116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.686116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.686116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.686116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.686116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.686116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.686116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.686116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.686536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.686536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.686536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.686536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.686718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.686718] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.751230] env[65678]: INFO networking_nsxv3.common.synchronization [None req-0d1ff424-9a7f-4386-ba7d-30eab54fa534 None None] Enqueued Resource ID: 74f9e4a1-75b1-4255-ba19-8c15c01d841c with Priority: HIGHEST for action port [ 764.751230] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74f9e4a1-75b1-4255-ba19-8c15c01d841c with Priority: HIGHEST for action port [ 764.751230] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-74f9e4a1-75b1-4255-ba19-8c15c01d841c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.751230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74f9e4a1-75b1-4255-ba19-8c15c01d841c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.751230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74f9e4a1-75b1-4255-ba19-8c15c01d841c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.751230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74f9e4a1-75b1-4255-ba19-8c15c01d841c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.751230] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74f9e4a1-75b1-4255-ba19-8c15c01d841c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.120885] env[65678]: INFO networking_nsxv3.common.synchronization [req-b947304a-c5f3-4043-a782-c907690dd063 req-9e765442-226f-444e-99f7-468c724fe1e0 tempest-ImagesOneServerNegativeTestJSON-281812694 tempest-ImagesOneServerNegativeTestJSON-281812694-project-member] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 765.121981] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 765.121981] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.121981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.124994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.124994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.124994] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.125259] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.125334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.125594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.125690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.125789] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.190933] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 634f27f8-e5b0-4d71-84ce-45af2c1641e2: rpc.has_security_group_logging(os_id): False [ 765.211223] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.212203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.212203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.212203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.212203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.212333] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.212393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.212425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.213044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.213044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.213044] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.213044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.213044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.213257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.213257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.213408] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.213496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.213557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.213692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.213767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.214722] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be created. [ 765.256155] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74f9e4a1-75b1-4255-ba19-8c15c01d841c [ 765.256155] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.256155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.256155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.256155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.256155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.256155] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74f9e4a1-75b1-4255-ba19-8c15c01d841c already deleted. [ 765.256155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74f9e4a1-75b1-4255-ba19-8c15c01d841c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.282302] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.282458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.282693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.283671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.283671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.297959] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: IN_PROGRESS for 2s [ 765.631059] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.631520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.631520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.631520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.631716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.632342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.632342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.632342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.632342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.632342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.632342] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be updated. [ 765.669704] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.669704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.669704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.669704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.670288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.682233] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 767.248379] env[65678]: INFO networking_nsxv3.common.synchronization [req-19813976-a67b-4356-aff7-58b3852bb237 req-86940c57-b557-45aa-b3e1-15a6035166b9 tempest-InstanceActionsTestJSON-273588170 tempest-InstanceActionsTestJSON-273588170-project-member] Enqueued Resource ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 with Priority: HIGHEST for action security_group_members [ 767.248379] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 with Priority: HIGHEST for action security_group_members [ 767.248379] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8fce09-ff14-4f78-bcad-d1a722c00977 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.252310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.252421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.252697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.252939] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.253088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.253156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.253318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.253444] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.253511] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8fce09-ff14-4f78-bcad-d1a722c00977',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.318889] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: SUCCESS [ 767.320225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.694947] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 767.695235] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 deletion is rescheduled due to dependency. [ 767.695391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.724411] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.724729] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-455" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.725199] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-455" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.725606] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-455" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.725716] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.725895] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.725986] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.726224] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.726350] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.726652] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.726734] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.726869] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.726969] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.727290] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.727387] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.727821] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.753269] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.753499] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.753670] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.753900] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-455" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.754284] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.754500] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.754667] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.755060] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.755229] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcaad2b5-6df9-49d5-b959-9e1ae75662fd',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.756297] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.756481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.756597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.756817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.756981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.757290] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.757482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.757600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.757880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.757998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.758202] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 already deleted. [ 767.758366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.261760] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.261760] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.261760] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.261760] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.261760] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.261760] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port fcaad2b5-6df9-49d5-b959-9e1ae75662fd not found, creating... [ 768.262312] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.262312] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.262312] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.262561] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.263555] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.263555] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.263555] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.263555] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.263773] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.263842] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.264024] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: fcaad2b5-6df9-49d5-b959-9e1ae75662fd is going to be created. [ 768.285568] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.285976] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.286120] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.286398] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.286627] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.286927] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.291087] env[65678]: INFO networking_nsxv3.common.synchronization [req-e4995bde-b0aa-4155-8844-1134292f2171 req-53cee58e-dd7e-4832-8259-a295d55323d4 tempest-ListServersNegativeTestJSON-1141148033 tempest-ListServersNegativeTestJSON-1141148033-project-member] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 769.291725] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 769.292072] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.292264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.292264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.292473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.292628] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.292731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.292777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.293011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.293115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.293210] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.577179] env[65678]: INFO networking_nsxv3.common.synchronization [req-19813976-a67b-4356-aff7-58b3852bb237 req-d7d7be6a-d077-482a-a266-e22f31443a21 service nova] Enqueued Resource ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 with Priority: HIGHEST for action security_group_rules [ 769.577401] env[65678]: INFO networking_nsxv3.common.synchronization [req-19813976-a67b-4356-aff7-58b3852bb237 req-d7d7be6a-d077-482a-a266-e22f31443a21 service nova] Enqueued Resource ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 with Priority: HIGHEST for action security_group_members [ 769.577551] env[65678]: INFO networking_nsxv3.common.synchronization [req-19813976-a67b-4356-aff7-58b3852bb237 req-d7d7be6a-d077-482a-a266-e22f31443a21 service nova] Enqueued Resource ID: fcaad2b5-6df9-49d5-b959-9e1ae75662fd with Priority: HIGHEST for action port [ 769.578109] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 with Priority: HIGHEST for action security_group_rules [ 769.578340] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 with Priority: HIGHEST for action security_group_members [ 769.578340] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcaad2b5-6df9-49d5-b959-9e1ae75662fd with Priority: HIGHEST for action port [ 769.578593] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f8fce09-ff14-4f78-bcad-d1a722c00977 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.578704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.578910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.579055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.579111] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f8fce09-ff14-4f78-bcad-d1a722c00977',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.580498] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8fce09-ff14-4f78-bcad-d1a722c00977 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.580683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.580758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.581182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.581373] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.581497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.581552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.581697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.581846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.581907] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8fce09-ff14-4f78-bcad-d1a722c00977',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.583068] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.583268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.583382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.586808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.586808] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcaad2b5-6df9-49d5-b959-9e1ae75662fd',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.709637] env[65678]: INFO networking_nsxv3.common.synchronization [req-355e88da-9016-46e4-aec5-bc1a97c263a9 req-ff4ef155-c65f-4ef0-a7e3-7142c86c464b tempest-ListServersNegativeTestJSON-1141148033 tempest-ListServersNegativeTestJSON-1141148033-project-member] Enqueued Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 769.710768] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 with Priority: HIGHEST for action security_group_members [ 769.711347] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.711556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.796219] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.087255] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8fce09-ff14-4f78-bcad-d1a722c00977 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.087255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.087255] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f8fce09-ff14-4f78-bcad-d1a722c00977',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.088322] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcaad2b5-6df9-49d5-b959-9e1ae75662fd with status ACTIVE [ 770.088900] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.088900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.088900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.089208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.090333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.092409] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.092409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.092409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.092409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.092409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.093091] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.093091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.093091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.093091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.093294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.093294] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcaad2b5-6df9-49d5-b959-9e1ae75662fd is going to be updated. [ 770.132064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.132064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.132064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.132064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.133223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.133223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcaad2b5-6df9-49d5-b959-9e1ae75662fd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.299440] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.595996] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f8fce09-ff14-4f78-bcad-d1a722c00977',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.803050] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.803050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.803498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.803498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.803794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.804256] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be updated. [ 770.837821] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.837821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.837821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.837821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.837821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.849109] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 771.098110] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.098263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.098382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.098549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.098637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.098730] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 is going to be created. [ 771.140327] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.140512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.140585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.140855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.141034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.153442] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 in Status: UNINITIALIZED for 2s [ 772.865630] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 772.866726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.866726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.866726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.866726] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.866726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.866726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.867129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.867129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.867129] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6bf254fe-a02c-4c36-8f89-52a5a801f9b5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.166970] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 in Status: SUCCESS [ 773.167255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.167437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.167668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.167937] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.168016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.168052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.173634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.173634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.173634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.173634] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f8fce09-ff14-4f78-bcad-d1a722c00977',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.253139] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-d5263073-f1c0-428f-94c7-d27bac70004c tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 773.255114] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 773.256044] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.256044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.256044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.256044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.256287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.256287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.256369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.256495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.256595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.256708] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.370896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.374656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.374656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.374656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.374656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.374656] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.374656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.374656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.374656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.374656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.374656] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 is going to be updated. [ 773.427197] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.427197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.427197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.427481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.427596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.440500] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: IN_PROGRESS for 2s [ 773.672661] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8fce09-ff14-4f78-bcad-d1a722c00977 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.672895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.672895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.673061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.673252] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.673363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.673423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.674035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.674035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.674035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.674035] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8fce09-ff14-4f78-bcad-d1a722c00977 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.674035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.674439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.674439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.674439] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.674439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.674557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.674832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.674832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.674832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.675012] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f8fce09-ff14-4f78-bcad-d1a722c00977',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.691511] env[65678]: INFO networking_nsxv3.common.synchronization [None req-dd4c4d47-7932-4780-94ff-db381c6d4fae None None] Enqueued Resource ID: df2fd0ab-dd22-436b-82a0-a8bb0ee33398 with Priority: HIGHEST for action port [ 773.692026] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2fd0ab-dd22-436b-82a0-a8bb0ee33398 with Priority: HIGHEST for action port [ 773.692401] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-df2fd0ab-dd22-436b-82a0-a8bb0ee33398 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.692525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df2fd0ab-dd22-436b-82a0-a8bb0ee33398" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.692600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df2fd0ab-dd22-436b-82a0-a8bb0ee33398" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.692928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df2fd0ab-dd22-436b-82a0-a8bb0ee33398" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.693559] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df2fd0ab-dd22-436b-82a0-a8bb0ee33398',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.759867] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.761545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.761545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.761545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.761545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.761545] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.761545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.761545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.761545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.761545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.761545] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d already deleted. [ 773.761545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.857656] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-9470d74f-278c-4fd5-b5e2-d6a1b8f29943 tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 773.858211] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 773.858517] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.858641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.858707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.858905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.859069] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.859174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.859227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.859378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.859463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.859556] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.181862] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f8fce09-ff14-4f78-bcad-d1a722c00977: rpc.has_security_group_logging(os_id): False [ 774.196834] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df2fd0ab-dd22-436b-82a0-a8bb0ee33398 [ 774.196834] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.196834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.196834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.197117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.197117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.197197] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df2fd0ab-dd22-436b-82a0-a8bb0ee33398 already deleted. [ 774.197301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df2fd0ab-dd22-436b-82a0-a8bb0ee33398" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.203313] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.203457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.203510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.203855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.203855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.204085] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.204234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.204307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.204525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.204609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.204871] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.204985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.205070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.205254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.205353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.205614] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.205734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.205796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.205942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.206027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.206114] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 is going to be created. [ 774.305204] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.305204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.305204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.305204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.305204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.325658] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 in Status: IN_PROGRESS for 2s [ 774.362782] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.362782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.363063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.363412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.363646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.367029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.367029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.367029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.367029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.367029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.367029] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d already deleted. [ 774.367029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.733731] env[65678]: INFO networking_nsxv3.common.synchronization [req-e9baf0b8-b3b7-44ab-bd49-126955ca9521 req-bbbfd507-577e-4e20-9e77-3d14ed7e219b tempest-ListServerFiltersTestJSON-129772598 tempest-ListServerFiltersTestJSON-129772598-project-member] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 774.733731] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 774.733731] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.733731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.733731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.734069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.734181] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.734181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.734260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.734488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.734625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.734729] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.021746] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-fbacc3be-f94d-4c53-9273-b3368f5fcd97 tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 775.023051] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 775.023051] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.023373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.023373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.025022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.025022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.025022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.025022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.025022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.025022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.025022] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.239411] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.451924] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 in Status: SUCCESS [ 775.452739] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6bf254fe-a02c-4c36-8f89-52a5a801f9b5 deletion is rescheduled due to dependency. [ 775.452739] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6bf254fe-a02c-4c36-8f89-52a5a801f9b5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.517590] env[65678]: INFO networking_nsxv3.common.synchronization [req-6b6ec5f9-fc8b-4d91-9f3f-aa6adac24c59 req-2e4613b1-3ef2-40e0-9ed6-a86a4168f949 tempest-ServersTestFqdnHostnames-1424597037 tempest-ServersTestFqdnHostnames-1424597037-project-member] Enqueued Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_members [ 775.517590] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGHEST for action security_group_members [ 775.517590] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.517590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.517590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.517590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.517590] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.517590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.517590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.518037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.518037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.518037] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.527328] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.528063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.528178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.528483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.528643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.528879] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.529932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.529932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.529932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.529932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.529932] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d already deleted. [ 775.529932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.702627] env[65678]: INFO networking_nsxv3.common.synchronization [None req-8d17f10b-fee3-41d1-800c-f10b84ffe670 None None] Enqueued Resource ID: ba47e243-bc37-47bc-aeaf-7e8d269beb8c with Priority: HIGHEST for action port [ 775.702627] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba47e243-bc37-47bc-aeaf-7e8d269beb8c with Priority: HIGHEST for action port [ 775.702627] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba47e243-bc37-47bc-aeaf-7e8d269beb8c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.702627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba47e243-bc37-47bc-aeaf-7e8d269beb8c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.702627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba47e243-bc37-47bc-aeaf-7e8d269beb8c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.702627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba47e243-bc37-47bc-aeaf-7e8d269beb8c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.702627] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba47e243-bc37-47bc-aeaf-7e8d269beb8c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.741507] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.874199] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.875022] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-950" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.875478] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-950" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.876123] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-950" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.878786] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.878786] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.878786] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.878786] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.878786] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.878786] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.878786] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.878786] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.881225] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.881600] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.881890] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.882267] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.910239] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.910239] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.910239] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.910239] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-950" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.910239] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.910239] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.910239] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.910239] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.910239] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6dafb52-3b66-439b-a46f-1a0ad1f29c06',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.022231] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.022651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.022753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.023188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.023395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.023588] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.023774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.023774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.024071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.024183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.024274] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb is going to be updated. [ 776.080563] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.080889] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.080889] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.081144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.081379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.096561] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb in Status: IN_PROGRESS for 2s [ 776.208052] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba47e243-bc37-47bc-aeaf-7e8d269beb8c [ 776.208052] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.208052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.208052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.208052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.208052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.208052] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba47e243-bc37-47bc-aeaf-7e8d269beb8c already deleted. [ 776.208052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba47e243-bc37-47bc-aeaf-7e8d269beb8c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.244464] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.244913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.244913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.245480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.245480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.245480] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be updated. [ 776.284056] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.284056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.284056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.284056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.284056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.294363] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 776.340406] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 in Status: SUCCESS [ 776.340618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.414106] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.414328] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.414430] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.414733] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.414883] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.415058] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port e6dafb52-3b66-439b-a46f-1a0ad1f29c06 not found, creating... [ 776.415314] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.415466] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.415582] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.415805] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.415974] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.416263] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.416424] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.416537] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.416734] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.416858] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.416998] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: e6dafb52-3b66-439b-a46f-1a0ad1f29c06 is going to be created. [ 776.447527] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.447527] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.447527] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.447527] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.447527] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.447527] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.180937] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-dc860d94-628c-4f75-a461-561284d82d69 service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 777.181333] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-dc860d94-628c-4f75-a461-561284d82d69 service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 777.181333] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-dc860d94-628c-4f75-a461-561284d82d69 service nova] Enqueued Resource ID: e6dafb52-3b66-439b-a46f-1a0ad1f29c06 with Priority: HIGHEST for action port [ 777.183042] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 777.183126] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 777.183275] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6dafb52-3b66-439b-a46f-1a0ad1f29c06 with Priority: HIGHEST for action port [ 777.183851] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.183851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.184036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.184402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.184402] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.186558] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.186558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.186558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.190122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.190122] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.190122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.190122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.190122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.190122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.190122] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.190677] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.190677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.190677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.190806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.190901] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6dafb52-3b66-439b-a46f-1a0ad1f29c06',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.697428] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.697767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.699904] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.701287] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6dafb52-3b66-439b-a46f-1a0ad1f29c06 with status ACTIVE [ 777.701562] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.701650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.701700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.702204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.702204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.702204] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.702410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.702410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.703562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.703562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.703562] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.703562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.703786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.703983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.704150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.704286] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6dafb52-3b66-439b-a46f-1a0ad1f29c06 is going to be updated. [ 777.752087] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.752087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.752087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.752087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.753110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.753611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6dafb52-3b66-439b-a46f-1a0ad1f29c06" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.088091] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.088491] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-806" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.088760] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-806" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.089271] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-806" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.089707] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.089939] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.090189] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.090612] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.090921] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.091284] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.091526] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.092034] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.092034] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.092222] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.092460] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.092715] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.107762] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb in Status: SUCCESS [ 778.108030] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb deletion is rescheduled due to dependency. [ 778.108198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.116861] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.116861] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 778.116861] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.117173] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-806" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.117493] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-ccb828fc-c844-48c2-96ec-e8ac412f7df0 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.117785] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-ccb828fc-c844-48c2-96ec-e8ac412f7df0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.117886] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-ccb828fc-c844-48c2-96ec-e8ac412f7df0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.118280] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-ccb828fc-c844-48c2-96ec-e8ac412f7df0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.118460] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccb828fc-c844-48c2-96ec-e8ac412f7df0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.207142] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.309558] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 778.310092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.622192] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.625024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.625024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.625024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.625024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.625024] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port ccb828fc-c844-48c2-96ec-e8ac412f7df0 not found, creating... [ 778.625024] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.625024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.625024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.625024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.625024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.625455] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.625455] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.625455] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.625455] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.625455] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.625455] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: ccb828fc-c844-48c2-96ec-e8ac412f7df0 is going to be created. [ 778.652023] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.652023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.652023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.652023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.652023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.652023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-ccb828fc-c844-48c2-96ec-e8ac412f7df0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.709619] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.710036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.710036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.710141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.710203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.710575] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be created. [ 778.739967] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent loop - iteration:0 completed [ 778.739967] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent loop - iteration:1 started [ 778.750272] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.750438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.750515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.750991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.750991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.767429] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: UNINITIALIZED for 2s [ 779.083616] env[65678]: INFO networking_nsxv3.common.synchronization [req-03a7e2a1-5cd1-423e-a2b4-2b12e8e66cc6 req-55f0ed09-d5bd-42c5-a7e7-007f1827ecfe tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 779.084326] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 779.084537] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.084682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.084682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.084819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.085373] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.085373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.085373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.085373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.085373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.085581] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.359487] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-09999a97-4f81-4457-986b-d0c3f3af918a service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 779.360470] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-09999a97-4f81-4457-986b-d0c3f3af918a service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 779.360470] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-09999a97-4f81-4457-986b-d0c3f3af918a service nova] Enqueued Resource ID: ccb828fc-c844-48c2-96ec-e8ac412f7df0 with Priority: HIGHEST for action port [ 779.360470] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 779.360614] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 779.360614] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb828fc-c844-48c2-96ec-e8ac412f7df0 with Priority: HIGHEST for action port [ 779.361421] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.361421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.361421] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.361578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.361976] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccb828fc-c844-48c2-96ec-e8ac412f7df0 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.361976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccb828fc-c844-48c2-96ec-e8ac412f7df0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.361976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccb828fc-c844-48c2-96ec-e8ac412f7df0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.362174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccb828fc-c844-48c2-96ec-e8ac412f7df0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.362210] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccb828fc-c844-48c2-96ec-e8ac412f7df0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.587334] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.682507] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.682780] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-134" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.684133] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-134" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.684599] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-134" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.684923] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.685131] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.686271] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.686807] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.687014] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.687288] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.687506] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.687723] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.687975] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.688205] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.688446] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.688696] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.711523] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.712904] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 779.713200] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.714134] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-134" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.714569] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.714792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.714915] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.715337] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.715506] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae37f90-2841-4cff-a9d7-bbd8d5aa4987',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.865664] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccb828fc-c844-48c2-96ec-e8ac412f7df0 with status ACTIVE [ 779.865979] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.866270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.866270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.866565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.866698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.866884] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.867017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.867135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.867377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.867465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.867651] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.867809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.867948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.868140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.868221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.868309] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccb828fc-c844-48c2-96ec-e8ac412f7df0 is going to be updated. [ 779.896589] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.896855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.896855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.896994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.897155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.897322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccb828fc-c844-48c2-96ec-e8ac412f7df0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.089441] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.219048] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.219048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.219048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.219048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.219048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.219441] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port dae37f90-2841-4cff-a9d7-bbd8d5aa4987 not found, creating... [ 780.219618] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.219618] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.219773] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.219965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.220128] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.220405] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.220554] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.220665] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.220945] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.221094] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.221499] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 is going to be created. [ 780.243995] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.244241] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.244365] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.244649] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.244881] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.245120] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.594549] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.594737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.594855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.595022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.595139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.595307] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 780.630099] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.630299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.630299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.630561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.630708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.641814] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 780.780186] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 780.780707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.780707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.780962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.781202] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.781365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.781453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.781766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.781851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.782093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.782174] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.783234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.783639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.783872] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.784080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.784151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.784283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.784365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.784461] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.963905] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.964145] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-950" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.964278] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-950" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.964874] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-950" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.965210] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.965412] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.965554] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.966032] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.966189] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.966439] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.966774] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.966971] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.967141] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.967317] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.967397] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.967507] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.989730] env[65678]: INFO networking_nsxv3.common.synchronization [req-03a7e2a1-5cd1-423e-a2b4-2b12e8e66cc6 req-48864988-1000-4530-aa3a-6deffeebbd68 service nova] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 780.989887] env[65678]: INFO networking_nsxv3.common.synchronization [req-03a7e2a1-5cd1-423e-a2b4-2b12e8e66cc6 req-48864988-1000-4530-aa3a-6deffeebbd68 service nova] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 780.990040] env[65678]: INFO networking_nsxv3.common.synchronization [req-03a7e2a1-5cd1-423e-a2b4-2b12e8e66cc6 req-48864988-1000-4530-aa3a-6deffeebbd68 service nova] Enqueued Resource ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 with Priority: HIGHEST for action port [ 780.991860] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.991969] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.992128] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.992358] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-950" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.992681] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-68e709ac-ff55-4753-9723-3a3ad49ff836 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.992916] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-68e709ac-ff55-4753-9723-3a3ad49ff836" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.993072] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-68e709ac-ff55-4753-9723-3a3ad49ff836" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.993402] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-68e709ac-ff55-4753-9723-3a3ad49ff836" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.993553] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68e709ac-ff55-4753-9723-3a3ad49ff836',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.995508] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 780.995508] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 780.995508] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 with Priority: HIGHEST for action port [ 780.995700] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.995700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.995789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.996043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.996043] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.997644] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.997644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.997644] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.997644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.997644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.997644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.997644] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae37f90-2841-4cff-a9d7-bbd8d5aa4987',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.287454] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.287454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.288853] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.303358] env[65678]: INFO networking_nsxv3.common.synchronization [None req-910bedf0-b712-4c45-a951-e157e41a18e1 None None] Enqueued Resource ID: 3a7002da-a5c8-4c7c-b99c-0458f2d9e762 with Priority: HIGHEST for action port [ 781.305935] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a7002da-a5c8-4c7c-b99c-0458f2d9e762 with Priority: HIGHEST for action port [ 781.307414] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a7002da-a5c8-4c7c-b99c-0458f2d9e762 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.308424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a7002da-a5c8-4c7c-b99c-0458f2d9e762" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.308424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a7002da-a5c8-4c7c-b99c-0458f2d9e762" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.308582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a7002da-a5c8-4c7c-b99c-0458f2d9e762" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.308582] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a7002da-a5c8-4c7c-b99c-0458f2d9e762',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.496446] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.496664] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.496780] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.497083] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.498649] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.498825] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 68e709ac-ff55-4753-9723-3a3ad49ff836 not found, creating... [ 781.499217] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.499330] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.499460] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.499871] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.499871] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.500197] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.500345] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.500429] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.500763] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.500763] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.500973] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 68e709ac-ff55-4753-9723-3a3ad49ff836 is going to be created. [ 781.505147] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.505147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.505147] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dae37f90-2841-4cff-a9d7-bbd8d5aa4987 with status ACTIVE [ 781.505147] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.505147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.505147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.505147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.505147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.505147] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.505147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.505147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.505147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.505147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.505147] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.506146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.506146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.506146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.506146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.506146] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 is going to be updated. [ 781.535776] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.535990] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.536273] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.536703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.537064] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.537334] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-68e709ac-ff55-4753-9723-3a3ad49ff836" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.539513] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.539630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.539630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.539807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.539936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.540110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.795317] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.812009] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a7002da-a5c8-4c7c-b99c-0458f2d9e762 [ 781.812320] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.812484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.812565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.812810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.813011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.813377] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a7002da-a5c8-4c7c-b99c-0458f2d9e762 already deleted. [ 781.813489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a7002da-a5c8-4c7c-b99c-0458f2d9e762" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.274349] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-29c276da-f0a3-4bb9-9154-dc6f1efe8340 service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 782.274349] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-29c276da-f0a3-4bb9-9154-dc6f1efe8340 service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 782.274349] env[65678]: INFO networking_nsxv3.common.synchronization [req-461f0c41-0511-4f7d-b133-1a3cf70e051b req-29c276da-f0a3-4bb9-9154-dc6f1efe8340 service nova] Enqueued Resource ID: 68e709ac-ff55-4753-9723-3a3ad49ff836 with Priority: HIGHEST for action port [ 782.274349] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 782.274349] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 782.274349] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e709ac-ff55-4753-9723-3a3ad49ff836 with Priority: HIGHEST for action port [ 782.274349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.274349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.274707] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.274918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.275233] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-68e709ac-ff55-4753-9723-3a3ad49ff836 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.275461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68e709ac-ff55-4753-9723-3a3ad49ff836" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.275772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68e709ac-ff55-4753-9723-3a3ad49ff836" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.276137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68e709ac-ff55-4753-9723-3a3ad49ff836" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.276310] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68e709ac-ff55-4753-9723-3a3ad49ff836',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.300051] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.300051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.300051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.300051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.300051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.300051] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 782.335429] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.335580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.335655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.336216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.336216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.345949] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 782.654153] env[65678]: INFO networking_nsxv3.common.synchronization [req-69cd392c-4c95-4c16-99ba-2b26ebda2502 req-871e7258-20cf-43cc-9e97-2f465e2da98d tempest-ServerMetadataTestJSON-1119160030 tempest-ServerMetadataTestJSON-1119160030-project-member] Enqueued Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGHEST for action security_group_members [ 782.655425] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 782.655758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.656376] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGHEST for action security_group_members [ 782.656853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.657214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.657280] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.657406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.657463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.657615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.657689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.657787] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.658948] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.659104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.659142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.659354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.659503] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.659605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.659670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.659814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.660068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.660068] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d8bedd-dc94-41cb-aa04-1d71595ff0bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.788774] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68e709ac-ff55-4753-9723-3a3ad49ff836 with status ACTIVE [ 782.788774] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.788774] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.788774] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.788774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.788774] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68e709ac-ff55-4753-9723-3a3ad49ff836 is going to be updated. [ 782.821143] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.821143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.821143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.821143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.821143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.821143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68e709ac-ff55-4753-9723-3a3ad49ff836" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.144043] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-219 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.144275] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-219" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.144390] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-219" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.144734] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-219" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.145105] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.145290] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.145455] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.145725] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.146614] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.146614] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.146614] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.146614] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.146614] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.146614] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.146614] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.146898] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.164030] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.164510] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.164656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.164706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.164910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.164987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.165191] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.165285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.165346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.165570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.165676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.165803] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf already deleted. [ 783.165891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.169500] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.169589] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.170360] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.170360] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-219" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.170360] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-7f285f43-87df-4e3c-bc98-71357fd80aac taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.170552] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-7f285f43-87df-4e3c-bc98-71357fd80aac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.171322] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-7f285f43-87df-4e3c-bc98-71357fd80aac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.171322] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-7f285f43-87df-4e3c-bc98-71357fd80aac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.171322] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f285f43-87df-4e3c-bc98-71357fd80aac',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.668124] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.674799] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.675027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.675178] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.676379] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.676611] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.677173] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 7f285f43-87df-4e3c-bc98-71357fd80aac not found, creating... [ 783.677606] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.677606] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.677606] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.677810] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.677928] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.678289] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.678454] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.678563] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.678805] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.678971] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.679129] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 7f285f43-87df-4e3c-bc98-71357fd80aac is going to be created. [ 783.703542] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.703542] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.703542] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.703542] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.703542] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.704695] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-7f285f43-87df-4e3c-bc98-71357fd80aac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.985585] env[65678]: INFO networking_nsxv3.common.synchronization [None req-17cd62ee-e623-463a-89dc-9191293875ce tempest-ServersTestBootFromVolume-2101032171 tempest-ServersTestBootFromVolume-2101032171-project-member] Enqueued Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_rules [ 783.985943] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_rules [ 783.986259] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.986383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.986509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.986701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.986966] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.155236] env[65678]: INFO networking_nsxv3.common.synchronization [None req-27c18b99-615c-4d9f-927f-2433efbbcb0e tempest-ServersTestBootFromVolume-2101032171 tempest-ServersTestBootFromVolume-2101032171-project-member] Enqueued Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_rules [ 784.155997] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_rules [ 784.156102] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.156199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.174313] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.174313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.174313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.174313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.174313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.174313] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 784.206339] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.206481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.206550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.206789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.206904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.219656] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 784.358788] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 784.359832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.360049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.360308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.360607] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.360700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.360700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.360842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.360919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.361018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.361174] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.361262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.361305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.361570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.361570] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.361681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.361719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.362191] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.362191] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.362191] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.363324] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.365998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.365998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.365998] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.365998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.366195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.366225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.366287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.366374] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.436045] env[65678]: INFO networking_nsxv3.common.synchronization [None req-9cab768d-6d81-48c1-874d-4f396a235ffd None None] Enqueued Resource ID: e2899d28-51c4-4b34-a91e-6b26c2ed61f8 with Priority: HIGHEST for action port [ 784.436809] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2899d28-51c4-4b34-a91e-6b26c2ed61f8 with Priority: HIGHEST for action port [ 784.437699] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2899d28-51c4-4b34-a91e-6b26c2ed61f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.437699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2899d28-51c4-4b34-a91e-6b26c2ed61f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.437699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2899d28-51c4-4b34-a91e-6b26c2ed61f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.437699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2899d28-51c4-4b34-a91e-6b26c2ed61f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.437849] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2899d28-51c4-4b34-a91e-6b26c2ed61f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.478793] env[65678]: INFO networking_nsxv3.common.synchronization [req-69cd392c-4c95-4c16-99ba-2b26ebda2502 req-0442bda7-4380-4d06-b48b-a3c8a32042ac service nova] Enqueued Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGHEST for action security_group_rules [ 784.479076] env[65678]: INFO networking_nsxv3.common.synchronization [req-69cd392c-4c95-4c16-99ba-2b26ebda2502 req-0442bda7-4380-4d06-b48b-a3c8a32042ac service nova] Enqueued Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGHEST for action security_group_members [ 784.479238] env[65678]: INFO networking_nsxv3.common.synchronization [req-69cd392c-4c95-4c16-99ba-2b26ebda2502 req-0442bda7-4380-4d06-b48b-a3c8a32042ac service nova] Enqueued Resource ID: 7f285f43-87df-4e3c-bc98-71357fd80aac with Priority: HIGHEST for action port [ 784.479812] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGHEST for action security_group_rules [ 784.479945] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGHEST for action security_group_members [ 784.480676] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f285f43-87df-4e3c-bc98-71357fd80aac with Priority: HIGHEST for action port [ 784.480983] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.481282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.481413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.481719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.481840] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95d8bedd-dc94-41cb-aa04-1d71595ff0bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.484757] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.484757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.484757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.484757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.484757] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.484757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.484757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.484757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.484757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.484757] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d8bedd-dc94-41cb-aa04-1d71595ff0bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.485785] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f285f43-87df-4e3c-bc98-71357fd80aac taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.486651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f285f43-87df-4e3c-bc98-71357fd80aac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.487046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f285f43-87df-4e3c-bc98-71357fd80aac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.487272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f285f43-87df-4e3c-bc98-71357fd80aac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.488488] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f285f43-87df-4e3c-bc98-71357fd80aac',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.513239] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.513239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.513239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.513239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.513522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.513522] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 already deleted. [ 784.513522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.514105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.514251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.514494] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.867200] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e24b48ad-1ed5-4566-912b-a63687a8de4d: rpc.has_security_group_logging(os_id): False [ 784.867754] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.895071] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.895071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.895071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.895071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.895071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.895071] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.895071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.895714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.895714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.895714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.895714] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.895899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.895899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.896019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.896680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.896680] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.896680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.896680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.896680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.896960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.896960] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be created. [ 784.940962] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2899d28-51c4-4b34-a91e-6b26c2ed61f8 [ 784.940962] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.940962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.940962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.940962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.940962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.941346] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2899d28-51c4-4b34-a91e-6b26c2ed61f8 already deleted. [ 784.941346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2899d28-51c4-4b34-a91e-6b26c2ed61f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.968282] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.968282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.968282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.968282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.968282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.979561] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 784.991081] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95d8bedd-dc94-41cb-aa04-1d71595ff0bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.992177] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.992789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.993912] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f285f43-87df-4e3c-bc98-71357fd80aac with status ACTIVE [ 784.995660] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.995828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.995880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.996099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.996189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.998392] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.998611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.998611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.998874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.998874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.999073] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.999170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.999325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.999375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.999474] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.999512] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f285f43-87df-4e3c-bc98-71357fd80aac is going to be updated. [ 785.034563] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.034563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.034825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.035306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.035306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.035590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f285f43-87df-4e3c-bc98-71357fd80aac" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.047669] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.047669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.047669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.048080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.048164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.048287] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 already deleted. [ 785.048395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.372388] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.494983] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95d8bedd-dc94-41cb-aa04-1d71595ff0bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.879086] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.879086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.879086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.879086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.879086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.879086] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 785.919572] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.919572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.919572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.920068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.921816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.941021] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 786.000416] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.000963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.000963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.000963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.001146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.001199] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf is going to be created. [ 786.059036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.059250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.059250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.059549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.060767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.079772] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf in Status: UNINITIALIZED for 2s [ 786.120989] env[65678]: INFO networking_nsxv3.common.synchronization [req-98244af4-6e59-4c62-9e16-a2d614f22425 req-16187798-e085-498f-8291-7e76fc0a51af tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 786.121934] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 786.122304] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.122482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.122583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.122898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.123116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.123268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.123368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.123613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.123812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.123999] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.233886] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 4s [ 786.626825] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.627046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.627275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.627520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.627618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.627835] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.627941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.628037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.628217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.628302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.628403] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d86ff68-550b-40c3-8567-854372ec34de is going to be updated. [ 786.667151] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.667151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.667151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.667151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.667151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.677472] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: IN_PROGRESS for 2s [ 786.750664] env[65678]: INFO networking_nsxv3.common.synchronization [req-f483371c-2842-42c8-a126-278e16207f4b req-80fb91bb-bdee-4717-8e4c-bfeb3fb2285d tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_members [ 786.753278] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_members [ 786.754408] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d196335c-3d4b-49d3-91d2-49ab0c720654 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.754585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.754676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.754946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.756277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.756519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.756602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.757548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.758055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.758781] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.999132] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 787.001305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.001305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.001305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.001305] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.196288] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.196491] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.196628] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.196988] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.197293] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.197453] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.197594] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.197892] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.198020] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.198225] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 787.198335] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.198442] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.198571] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.198748] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 787.198867] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.199036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.224216] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.224216] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 787.224216] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.224216] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.224216] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-fbc462b6-2675-4053-941d-c37dde274608 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.225162] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-fbc462b6-2675-4053-941d-c37dde274608" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.225549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-fbc462b6-2675-4053-941d-c37dde274608" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.226166] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-fbc462b6-2675-4053-941d-c37dde274608" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.226545] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbc462b6-2675-4053-941d-c37dde274608',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.266300] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.266300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.266300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.266300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.266300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.266300] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.266300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.266300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.267165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.267274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.267378] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d196335c-3d4b-49d3-91d2-49ab0c720654 already deleted. [ 787.267498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.503262] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.503520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.730059] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.730345] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.730512] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.730848] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.731071] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.731261] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port fbc462b6-2675-4053-941d-c37dde274608 not found, creating... [ 787.731584] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.731785] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.731926] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.732248] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.732419] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.736021] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.736021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.736021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.736021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.736021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.736021] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: fbc462b6-2675-4053-941d-c37dde274608 is going to be created. [ 787.796941] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.797370] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.797800] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.797981] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.801620] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.801620] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-fbc462b6-2675-4053-941d-c37dde274608" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.932083] env[65678]: INFO networking_nsxv3.common.synchronization [req-05bcb787-6640-42b1-8a07-82496dd93c90 req-9afe4032-a269-49f2-a48c-d8e69e8c5887 tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 787.932984] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 787.933128] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.933228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.933295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.933495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.933645] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.933742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.933805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.933950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.934050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.934143] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.953711] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 787.954044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.956555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.956555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.956555] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.956555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.956555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.956555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.956555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.956555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.956555] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.090876] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf in Status: SUCCESS [ 788.090876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.091254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.091254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.091344] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.091432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.091478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.091637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.091713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.091792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.091879] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95d8bedd-dc94-41cb-aa04-1d71595ff0bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.244512] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 788.244641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.244848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.245109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.245305] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.245432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.245499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.245665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.246217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.247469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.247469] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.441102] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.441102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.441102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.441102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.441102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.441102] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.441102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.441102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.441102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.441102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.441102] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 788.461511] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.461835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.461911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.462152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.462342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.462416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.462490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.464674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.464674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.464674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.464674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.464674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.464674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.464674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.465265] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.465407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.465476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.465789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.465789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.465884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.465947] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.489244] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.489598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.489694] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.489914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.490083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.494164] env[65678]: INFO networking_nsxv3.common.synchronization [req-f483371c-2842-42c8-a126-278e16207f4b req-132b62b4-9782-453c-a48d-7b6dd2505a87 service nova] Enqueued Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_rules [ 788.494354] env[65678]: INFO networking_nsxv3.common.synchronization [req-f483371c-2842-42c8-a126-278e16207f4b req-132b62b4-9782-453c-a48d-7b6dd2505a87 service nova] Enqueued Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_members [ 788.494594] env[65678]: INFO networking_nsxv3.common.synchronization [req-f483371c-2842-42c8-a126-278e16207f4b req-132b62b4-9782-453c-a48d-7b6dd2505a87 service nova] Enqueued Resource ID: fbc462b6-2675-4053-941d-c37dde274608 with Priority: HIGHEST for action port [ 788.495340] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_rules [ 788.495476] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_members [ 788.495618] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc462b6-2675-4053-941d-c37dde274608 with Priority: HIGHEST for action port [ 788.495842] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d196335c-3d4b-49d3-91d2-49ab0c720654 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.495953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.496036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.496254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.496337] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.497919] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d196335c-3d4b-49d3-91d2-49ab0c720654 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.498047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.498116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.498304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.498459] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.498556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.498619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.498903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.498998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.499115] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.500384] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbc462b6-2675-4053-941d-c37dde274608 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.500504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbc462b6-2675-4053-941d-c37dde274608" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.500552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbc462b6-2675-4053-941d-c37dde274608" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.501393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbc462b6-2675-4053-941d-c37dde274608" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.501489] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbc462b6-2675-4053-941d-c37dde274608',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.504639] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 788.595214] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.595389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.595560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.595723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.595940] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.595940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.596106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.596185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.596271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.596701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.596701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.596701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.596701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.596932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.596932] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.597026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.597121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.597288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.597411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.597464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.597561] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95d8bedd-dc94-41cb-aa04-1d71595ff0bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.690260] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: SUCCESS [ 788.690785] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d86ff68-550b-40c3-8567-854372ec34de deletion is rescheduled due to dependency. [ 788.690891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.749781] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.750166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.751143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.751143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.751143] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.751301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.751352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.751928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.751928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.751928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.752167] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.752290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.752456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.752720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.753380] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.753380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.753380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.753544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.753577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.753860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.753860] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.969145] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e24b48ad-1ed5-4566-912b-a63687a8de4d: rpc.has_security_group_logging(os_id): False [ 788.992166] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.992364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.992406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.992640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.992933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.993349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.993593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.993677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.994815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.994815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.994815] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.994815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.994815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.995065] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.995065] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.995238] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.995330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.995390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.995697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.995774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.995927] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 788.998978] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d196335c-3d4b-49d3-91d2-49ab0c720654 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.999211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.000548] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.007714] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbc462b6-2675-4053-941d-c37dde274608 with status ACTIVE [ 789.008047] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.008368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.008471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.008674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.008887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.009112] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.009224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.009303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.009669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.009876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.010114] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.010226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.010263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.010994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.010994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.010994] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbc462b6-2675-4053-941d-c37dde274608 is going to be updated. [ 789.044515] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.044515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.044515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.044901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.044901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.044975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbc462b6-2675-4053-941d-c37dde274608" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.106144] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95d8bedd-dc94-41cb-aa04-1d71595ff0bf: rpc.has_security_group_logging(os_id): False [ 789.139534] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.139534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.139534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.139833] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.140151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.140312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.140491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.140617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.141063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.141211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.141642] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.141775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.141883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.142165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.142314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.142681] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.142846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.143035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.143291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.143898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.143898] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf is going to be created. [ 789.169723] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.169897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.169943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.170266] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.170389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.186859] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 789.245592] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.245742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.245802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.246031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.246215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.257048] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393a6f14-3ce6-441b-a403-1993c47b58e3: rpc.has_security_group_logging(os_id): False [ 789.277458] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf in Status: IN_PROGRESS for 2s [ 789.311467] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.311613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.311690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.311906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.312010] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.312238] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.312340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.312419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.312579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.312699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.313025] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.313135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.313203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.313360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.313477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.313722] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.313842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.313925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.314206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.314328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.314461] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 789.467241] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.467241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.467241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.467496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.467629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.485234] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 789.502957] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.007683] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.007683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.007683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.007683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.007683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.007683] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d196335c-3d4b-49d3-91d2-49ab0c720654 is going to be created. [ 790.048353] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.048353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.048487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.049184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.049724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.068139] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d196335c-3d4b-49d3-91d2-49ab0c720654 in Status: UNINITIALIZED for 2s [ 790.290694] env[65678]: INFO networking_nsxv3.common.synchronization [req-354b56a7-6e70-4143-82f9-1d7dbde538e1 req-cf1374c5-b8da-4e94-9ab8-73f33c785d50 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 790.291040] env[65678]: INFO networking_nsxv3.common.synchronization [req-354b56a7-6e70-4143-82f9-1d7dbde538e1 req-cf1374c5-b8da-4e94-9ab8-73f33c785d50 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe with Priority: HIGHEST for action security_group_members [ 790.291666] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 790.292793] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe with Priority: HIGHEST for action security_group_members [ 790.292793] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.292793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.292793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.293287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.293287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.293287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.293403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.294817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.294817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.294817] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.295570] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.295775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.296133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.296422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.296627] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.296750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.297031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.297031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.297123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.297348] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f1f3cf-3b5c-427a-8994-fa2238fe9dbe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.372208] env[65678]: INFO networking_nsxv3.common.synchronization [req-354b56a7-6e70-4143-82f9-1d7dbde538e1 req-cf1374c5-b8da-4e94-9ab8-73f33c785d50 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe with Priority: HIGHEST for action security_group_rules [ 790.372405] env[65678]: INFO networking_nsxv3.common.synchronization [req-354b56a7-6e70-4143-82f9-1d7dbde538e1 req-cf1374c5-b8da-4e94-9ab8-73f33c785d50 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe with Priority: HIGHEST for action security_group_members [ 790.372536] env[65678]: INFO networking_nsxv3.common.synchronization [req-354b56a7-6e70-4143-82f9-1d7dbde538e1 req-cf1374c5-b8da-4e94-9ab8-73f33c785d50 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_rules [ 790.372660] env[65678]: INFO networking_nsxv3.common.synchronization [req-354b56a7-6e70-4143-82f9-1d7dbde538e1 req-cf1374c5-b8da-4e94-9ab8-73f33c785d50 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 790.372791] env[65678]: INFO networking_nsxv3.common.synchronization [req-354b56a7-6e70-4143-82f9-1d7dbde538e1 req-cf1374c5-b8da-4e94-9ab8-73f33c785d50 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 88326e18-2322-4046-aca8-2055933064c9 with Priority: HIGHEST for action port [ 790.373924] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe with Priority: HIGHEST for action security_group_rules [ 790.374418] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_rules [ 790.374418] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88326e18-2322-4046-aca8-2055933064c9 with Priority: HIGHEST for action port [ 790.374418] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe with Priority: HIGHEST for action security_group_members [ 790.374565] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 790.374959] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.375144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.376358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.376358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.376505] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25f1f3cf-3b5c-427a-8994-fa2238fe9dbe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.377754] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.377754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.377754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.378073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.378073] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.380090] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-88326e18-2322-4046-aca8-2055933064c9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.380090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.380090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.380090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.380090] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88326e18-2322-4046-aca8-2055933064c9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.380555] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.380899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.381179] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.381179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.517921] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 790.517921] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c deletion is rescheduled due to dependency. [ 790.517921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.715074] env[65678]: INFO networking_nsxv3.common.synchronization [None req-54655fb6-f228-459d-886b-a753e5d92d30 tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_rules [ 790.715730] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_rules [ 790.716540] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2de4eec-43fc-4180-be46-e291d4587236 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.717179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.717179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.717179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.717179] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.799409] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.800805] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25f1f3cf-3b5c-427a-8994-fa2238fe9dbe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.854045] env[65678]: INFO networking_nsxv3.common.synchronization [None req-08bbd96e-5146-4284-b1d8-97cd048b2b8a tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_rules [ 790.856268] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_rules [ 790.856701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2de4eec-43fc-4180-be46-e291d4587236 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.857067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.882449] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88326e18-2322-4046-aca8-2055933064c9 with status ACTIVE [ 790.882732] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.882938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.883041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.883273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.883351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.883543] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.883642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.883714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.883858] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.883933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.884132] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.884224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.884275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.884412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.884484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.884565] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88326e18-2322-4046-aca8-2055933064c9 is going to be updated. [ 790.886493] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.886493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.886493] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.886493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.911951] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.912487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.912487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.912723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.912997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.913264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.202308] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 791.202605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.202818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.203138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.203241] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.245976] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.246092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.246092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.246357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.246455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.246607] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2de4eec-43fc-4180-be46-e291d4587236 already deleted. [ 791.246685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.246825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.247048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.247147] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.290078] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf in Status: SUCCESS [ 791.290365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.303462] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.305088] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25f1f3cf-3b5c-427a-8994-fa2238fe9dbe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.320954] env[65678]: INFO networking_nsxv3.common.synchronization [req-414f3431-9053-46b7-b3fb-a7587b971016 req-f89993f9-4cc1-4145-b433-a79e5c021ee6 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 791.321287] env[65678]: INFO networking_nsxv3.common.synchronization [req-414f3431-9053-46b7-b3fb-a7587b971016 req-f89993f9-4cc1-4145-b433-a79e5c021ee6 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe with Priority: HIGHEST for action security_group_members [ 791.322042] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 791.322126] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe with Priority: HIGHEST for action security_group_members [ 791.322685] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.322891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.323130] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.323236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.375570] env[65678]: INFO networking_nsxv3.common.synchronization [req-414f3431-9053-46b7-b3fb-a7587b971016 req-f89993f9-4cc1-4145-b433-a79e5c021ee6 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_rules [ 791.375753] env[65678]: INFO networking_nsxv3.common.synchronization [req-414f3431-9053-46b7-b3fb-a7587b971016 req-f89993f9-4cc1-4145-b433-a79e5c021ee6 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 791.375892] env[65678]: INFO networking_nsxv3.common.synchronization [req-414f3431-9053-46b7-b3fb-a7587b971016 req-f89993f9-4cc1-4145-b433-a79e5c021ee6 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 88326e18-2322-4046-aca8-2055933064c9 with Priority: HIGHEST for action port [ 791.376408] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_rules [ 791.376543] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 791.376658] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88326e18-2322-4046-aca8-2055933064c9 with Priority: HIGHEST for action port [ 791.377507] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.377648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.378017] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.378189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.378916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-88326e18-2322-4046-aca8-2055933064c9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.383289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.383289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.383289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.383289] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88326e18-2322-4046-aca8-2055933064c9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.504165] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 791.504407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.705286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.706027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.706027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.706027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.706027] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.706027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.706355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.706355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.706355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.706504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.706504] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.773997] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.774338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.774338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.774610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.774710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.774848] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2de4eec-43fc-4180-be46-e291d4587236 already deleted. [ 791.775037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.808237] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.808446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.808493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.808735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.808847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.808998] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be updated. [ 791.810241] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.810356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.810424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.810632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.810715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.810804] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe is going to be created. [ 791.842086] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.842309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.842365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.842583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.842764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.847188] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.847427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.847486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.847672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.847824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.856867] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe in Status: UNINITIALIZED for 2s [ 791.858608] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: IN_PROGRESS for 2s [ 791.885068] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88326e18-2322-4046-aca8-2055933064c9 with status ACTIVE [ 791.885907] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.885907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.885907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.885907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.886276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.886276] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.886387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.886387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.887025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.887025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.887025] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.887025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.887025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.887255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.887255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.887335] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88326e18-2322-4046-aca8-2055933064c9 is going to be updated. [ 791.916130] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.916391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.916391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.917033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.917033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.917033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88326e18-2322-4046-aca8-2055933064c9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.925808] env[65678]: INFO networking_nsxv3.common.synchronization [None req-ddf96b62-b93a-4a8a-909a-1eac0be7d890 tempest-ServerRescueNegativeTestJSON-113281034 tempest-ServerRescueNegativeTestJSON-113281034-project-member] Enqueued Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_rules [ 791.926612] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_rules [ 791.926733] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.926853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.926853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.927660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.927763] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.066024] env[65678]: INFO networking_nsxv3.common.synchronization [req-8905e590-a8b0-4b6a-9684-d04fa79cda41 req-9d099b86-5727-4df5-8203-06e56915cb88 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 792.066024] env[65678]: INFO networking_nsxv3.common.synchronization [req-8905e590-a8b0-4b6a-9684-d04fa79cda41 req-9d099b86-5727-4df5-8203-06e56915cb88 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 792.066024] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 792.066024] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 792.066563] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.067962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.067962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.067962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.067962] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.067962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.067962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.067962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.067962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.067962] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.070816] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.070816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.070816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.070816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.070816] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.070816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.070816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.070816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.070816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.071466] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.076438] env[65678]: INFO networking_nsxv3.common.synchronization [None req-53341ed0-5856-4f11-8396-bf72df3fcc9d tempest-ServerRescueNegativeTestJSON-113281034 tempest-ServerRescueNegativeTestJSON-113281034-project-member] Enqueued Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_rules [ 792.077595] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_rules [ 792.081612] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.081727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.090908] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d196335c-3d4b-49d3-91d2-49ab0c720654 in Status: SUCCESS [ 792.091192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.091695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.091957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.092174] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.092293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.092357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.092526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.092607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.092690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.092781] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.139465] env[65678]: INFO networking_nsxv3.common.synchronization [req-8905e590-a8b0-4b6a-9684-d04fa79cda41 req-9d099b86-5727-4df5-8203-06e56915cb88 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_rules [ 792.139465] env[65678]: INFO networking_nsxv3.common.synchronization [req-8905e590-a8b0-4b6a-9684-d04fa79cda41 req-9d099b86-5727-4df5-8203-06e56915cb88 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 792.139465] env[65678]: INFO networking_nsxv3.common.synchronization [req-8905e590-a8b0-4b6a-9684-d04fa79cda41 req-9d099b86-5727-4df5-8203-06e56915cb88 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 792.139465] env[65678]: INFO networking_nsxv3.common.synchronization [req-8905e590-a8b0-4b6a-9684-d04fa79cda41 req-9d099b86-5727-4df5-8203-06e56915cb88 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 792.143770] env[65678]: INFO networking_nsxv3.common.synchronization [req-8905e590-a8b0-4b6a-9684-d04fa79cda41 req-9d099b86-5727-4df5-8203-06e56915cb88 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 with Priority: HIGHEST for action port [ 792.144528] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_rules [ 792.144674] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 792.144757] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 with Priority: HIGHEST for action port [ 792.144841] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 792.144970] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 792.145592] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.145730] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.145788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.149413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.149413] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.149413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.149413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.149413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.149413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.149413] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.149413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.149413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.149413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.149413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.149413] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae37f90-2841-4cff-a9d7-bbd8d5aa4987',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.149413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.149413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.150247] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.150247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.209695] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.209695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.209695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.210009] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.210009] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.210114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.211333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.211333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.211333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.211333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.211333] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.211333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.211333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.211333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.211747] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.211747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.211747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.212265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.212265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.212265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.212265] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.453206] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.453206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.453206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.453751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.453751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.453751] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 already deleted. [ 792.453751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.453910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.454075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.454159] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.575107] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.577806] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.595392] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.633974] env[65678]: INFO networking_nsxv3.common.synchronization [req-efd52571-d168-49ea-817b-e412e7ebc39e req-d93ab276-38f0-46e4-b591-a5994f6e0b36 tempest-ServersAdminNegativeTestJSON-1032160483 tempest-ServersAdminNegativeTestJSON-1032160483-project-member] Enqueued Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 792.635041] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 792.635041] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.635568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.635643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.635927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.636122] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.636226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.636280] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.636448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.636532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.636651] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.650313] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dae37f90-2841-4cff-a9d7-bbd8d5aa4987 with status ACTIVE [ 792.651211] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.651447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.651564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.651823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.651919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.652162] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.652487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.652487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.653228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.653228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.653228] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.653228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.653228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.653642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.653642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.653642] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 is going to be updated. [ 792.655346] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.655515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.655914] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.656076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.691235] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.691526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.691673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.691960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.692095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.692225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.715239] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e24b48ad-1ed5-4566-912b-a63687a8de4d: rpc.has_security_group_logging(os_id): False [ 792.748096] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.750021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.750021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.750021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.750021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.750021] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.750021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.750021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.750021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.750021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.750888] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.751248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.751424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.751722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.751950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.754052] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.754052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.754052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.754052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.754052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.754052] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 792.861609] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.861958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.861958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.862342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.862561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.888707] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 792.993189] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.994507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.995519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.995519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.995519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.995519] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 already deleted. [ 792.995519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.078189] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.080310] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.099404] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d196335c-3d4b-49d3-91d2-49ab0c720654: rpc.has_security_group_logging(os_id): False [ 793.124126] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.124356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.124356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.124562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.124653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.128068] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.128068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.128068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.128068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.128068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.128068] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d196335c-3d4b-49d3-91d2-49ab0c720654 is going to be created. [ 793.139018] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.139198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.139239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.139437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.139522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.139724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.139809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.139868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.140057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.140119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.140181] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2164111b-0060-40e2-86c3-edfc4931cb24 already deleted. [ 793.140257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.192912] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.193186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.193282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.193561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.194077] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.201431] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.201431] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.201431] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.201725] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.201790] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.202211] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.202211] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.202374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.202374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.202790] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.202790] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.202989] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.202989] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.203110] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.203879] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.203879] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.205631] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d196335c-3d4b-49d3-91d2-49ab0c720654 in Status: IN_PROGRESS for 2s [ 793.227566] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.227839] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.227839] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.228024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.228414] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-96979f34-628f-409d-b31b-9d6913b552b4 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.228700] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-96979f34-628f-409d-b31b-9d6913b552b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.228818] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-96979f34-628f-409d-b31b-9d6913b552b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.229188] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-96979f34-628f-409d-b31b-9d6913b552b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.229324] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96979f34-628f-409d-b31b-9d6913b552b4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.580984] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.581367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.581367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.582771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.582771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.582771] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 is going to be created. [ 793.582995] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.583124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.583193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.583371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.583521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.583595] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 793.622594] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.622846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.622846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.623136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.623310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.625706] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.626015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.626183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.626247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.630108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.644464] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 793.645377] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: UNINITIALIZED for 2s [ 793.733071] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.733574] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.733574] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.734045] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.734264] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.734498] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 96979f34-628f-409d-b31b-9d6913b552b4 not found, creating... [ 793.734875] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.735098] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.735306] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.735607] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.735788] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.736638] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.736857] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.737079] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.737384] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.737596] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.737796] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 96979f34-628f-409d-b31b-9d6913b552b4 is going to be created. [ 793.767116] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.767508] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.767508] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.767764] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.767995] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.768272] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-96979f34-628f-409d-b31b-9d6913b552b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.871814] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: SUCCESS [ 793.872367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.872436] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.872703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.872950] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.873228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.873228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.873473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.873539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.873658] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.875367] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe in Status: SUCCESS [ 793.875570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.875735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.875926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.876116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.876227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.876291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.876441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.876556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.876599] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f1f3cf-3b5c-427a-8994-fa2238fe9dbe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.379302] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.380525] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.380808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.380948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.381301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.382234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.382234] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.382234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.382234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.382942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.382942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.382942] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe is going to be deleted. [ 794.445249] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.445249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.445249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.445566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.445601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.445690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.445869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.446052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.446230] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.446355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.446417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.446530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.446609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.446703] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f1f3cf-3b5c-427a-8994-fa2238fe9dbe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.539196] env[65678]: INFO networking_nsxv3.common.synchronization [req-efd52571-d168-49ea-817b-e412e7ebc39e req-8ad923af-1395-4606-9437-a46d16fcbfa1 service nova] Enqueued Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_rules [ 794.540156] env[65678]: INFO networking_nsxv3.common.synchronization [req-efd52571-d168-49ea-817b-e412e7ebc39e req-8ad923af-1395-4606-9437-a46d16fcbfa1 service nova] Enqueued Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 794.540156] env[65678]: INFO networking_nsxv3.common.synchronization [req-efd52571-d168-49ea-817b-e412e7ebc39e req-8ad923af-1395-4606-9437-a46d16fcbfa1 service nova] Enqueued Resource ID: 96979f34-628f-409d-b31b-9d6913b552b4 with Priority: HIGHEST for action port [ 794.542612] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_rules [ 794.542612] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 794.542612] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96979f34-628f-409d-b31b-9d6913b552b4 with Priority: HIGHEST for action port [ 794.542612] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.542612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.542612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.542612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.542612] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.544934] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.544934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.544934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.544934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.544934] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.544934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.544934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.544934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.544934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.544934] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.545867] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-96979f34-628f-409d-b31b-9d6913b552b4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.545867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96979f34-628f-409d-b31b-9d6913b552b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.545867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96979f34-628f-409d-b31b-9d6913b552b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.546049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96979f34-628f-409d-b31b-9d6913b552b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.546149] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96979f34-628f-409d-b31b-9d6913b552b4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.885519] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.907121] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 794.907435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.952434] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.952586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.952657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.952931] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.953057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.953264] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.953365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.953414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.953568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.953643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.953724] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe already deleted. [ 794.954392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.954392] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25f1f3cf-3b5c-427a-8994-fa2238fe9dbe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.954782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.954945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.955936] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.956049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.956118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.957170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.957284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.957383] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f1f3cf-3b5c-427a-8994-fa2238fe9dbe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.047784] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.048804] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.048912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.049266] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96979f34-628f-409d-b31b-9d6913b552b4 with status ACTIVE [ 795.049433] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.049544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.049609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.049811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.049899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.050083] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.050183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.050233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.054022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.054022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.054022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.054022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.054022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.054022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.054022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.054022] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96979f34-628f-409d-b31b-9d6913b552b4 is going to be updated. [ 795.090990] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.090990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.090990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.090990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.090990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.090990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96979f34-628f-409d-b31b-9d6913b552b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.200504] env[65678]: INFO networking_nsxv3.common.synchronization [req-1ecc08fc-bb24-4a47-8ae9-2d7a1c2996ba req-e421a944-a508-40c4-86c9-5611541306b1 tempest-InstanceActionsTestJSON-273588170 tempest-InstanceActionsTestJSON-273588170-project-member] Enqueued Resource ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 with Priority: HIGHEST for action security_group_members [ 795.201534] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 with Priority: HIGHEST for action security_group_members [ 795.203689] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8fce09-ff14-4f78-bcad-d1a722c00977 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.203689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.203689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.203689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.203689] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.203689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.203689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.203689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.203689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.203689] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8fce09-ff14-4f78-bcad-d1a722c00977',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.233664] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d196335c-3d4b-49d3-91d2-49ab0c720654 in Status: SUCCESS [ 795.233868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.387966] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.388128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.388184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.388410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.388500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.388598] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be updated. [ 795.425978] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.426148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.426226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.426441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.426617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.439913] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: IN_PROGRESS for 2s [ 795.460269] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25f1f3cf-3b5c-427a-8994-fa2238fe9dbe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.461355] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.461577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.461680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.462629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.462629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.462629] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.462629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.462629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.463118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.463395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.463544] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe already deleted. [ 795.463660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.550595] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.661111] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: SUCCESS [ 795.661376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.662194] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 795.664085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.664352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.665078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.665078] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.665078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.665078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.665263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.665322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.665506] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.666812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.666979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.667198] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.667341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.667389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.667507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.668300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.668622] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.709511] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.709511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.709511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.709511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.709511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.709511] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.709511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.709511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.709511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.709511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.709511] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 is going to be updated. [ 795.740764] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.740764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.740764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.740764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.740764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.754869] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 in Status: IN_PROGRESS for 2s [ 795.966693] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe: rpc.has_security_group_logging(os_id): False [ 796.002649] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.002649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.002649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.002993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.004722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.004871] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.005275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.005433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.005800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.005946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.006622] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe is going to be created. [ 796.030184] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/25f1f3cf-3b5c-427a-8994-fa2238fe9dbe], does not exist path=[/infra/domains/default/groups/25f1f3cf-3b5c-427a-8994-fa2238fe9dbe]."\n}' [ 796.030184] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/25f1f3cf-3b5c-427a-8994-fa2238fe9dbe [ 796.030184] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 796.053600] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.053924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.053924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.054269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.054371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.054519] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2164111b-0060-40e2-86c3-edfc4931cb24 is going to be created. [ 796.085340] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.085340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.085484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.085633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.085827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.100992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.101297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.101362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.101629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.103490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.103849] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.104012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.104100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.104324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.104441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.104720] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.104827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.104900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.105092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.105226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.105292] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f1f3cf-3b5c-427a-8994-fa2238fe9dbe is going to be created. [ 796.107460] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: UNINITIALIZED for 2s [ 796.140055] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/25f1f3cf-3b5c-427a-8994-fa2238fe9dbe], does not exist path=[/infra/domains/default/groups/25f1f3cf-3b5c-427a-8994-fa2238fe9dbe]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/25f1f3cf-3b5c-427a-8994-fa2238fe9dbe [ 796.140055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25f1f3cf-3b5c-427a-8994-fa2238fe9dbe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.141037] env[65678]: Traceback (most recent call last): [ 796.141037] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 796.141037] env[65678]: return func(*args, **kwargs) [ 796.141037] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 796.141037] env[65678]: res.raise_for_status() [ 796.141037] env[65678]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 796.141037] env[65678]: raise HTTPError(http_error_msg, response=self) [ 796.141037] env[65678]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/25f1f3cf-3b5c-427a-8994-fa2238fe9dbe [ 796.141037] env[65678]: During handling of the above exception, another exception occurred: [ 796.141037] env[65678]: Traceback (most recent call last): [ 796.141037] env[65678]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 796.141037] env[65678]: listener.cb(fileno) [ 796.141037] env[65678]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 796.141037] env[65678]: result = function(*args, **kwargs) [ 796.141037] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 796.141037] env[65678]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 796.141037] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 796.141037] env[65678]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 796.141037] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 796.141037] env[65678]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 796.141037] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 796.141037] env[65678]: res.raise_for_status() [ 796.141037] env[65678]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 796.141037] env[65678]: raise HTTPError(http_error_msg, response=self) [ 796.141037] env[65678]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/25f1f3cf-3b5c-427a-8994-fa2238fe9dbe [ 796.141037] env[65678]: Removing descriptor: 21 [ 796.171604] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.173155] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.289283] env[65678]: INFO networking_nsxv3.common.synchronization [None req-cd704ab1-50fe-4cf6-8362-e403c8667aba tempest-ImagesOneServerNegativeTestJSON-281812694 tempest-ImagesOneServerNegativeTestJSON-281812694-project-member] Enqueued Resource ID: 2f4f2724-2797-4f45-af0a-70219c8cf7de with Priority: HIGHEST for action security_group_rules [ 796.289963] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4f2724-2797-4f45-af0a-70219c8cf7de with Priority: HIGHEST for action security_group_rules [ 796.290353] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4f2724-2797-4f45-af0a-70219c8cf7de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.290485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4f2724-2797-4f45-af0a-70219c8cf7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.290568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4f2724-2797-4f45-af0a-70219c8cf7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.290899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4f2724-2797-4f45-af0a-70219c8cf7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.290985] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4f2724-2797-4f45-af0a-70219c8cf7de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.425367] env[65678]: INFO networking_nsxv3.common.synchronization [None req-8db76a63-0127-4605-a58c-62981180cdbd tempest-ImagesOneServerNegativeTestJSON-281812694 tempest-ImagesOneServerNegativeTestJSON-281812694-project-member] Enqueued Resource ID: 2f4f2724-2797-4f45-af0a-70219c8cf7de with Priority: HIGHEST for action security_group_rules [ 796.425367] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f4f2724-2797-4f45-af0a-70219c8cf7de with Priority: HIGHEST for action security_group_rules [ 796.425830] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f4f2724-2797-4f45-af0a-70219c8cf7de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.426139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f4f2724-2797-4f45-af0a-70219c8cf7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.676415] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.676415] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.819307] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.819307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.819307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.819307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.819307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.819307] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4f2724-2797-4f45-af0a-70219c8cf7de already deleted. [ 796.819307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4f2724-2797-4f45-af0a-70219c8cf7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.819307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f4f2724-2797-4f45-af0a-70219c8cf7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.819829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f4f2724-2797-4f45-af0a-70219c8cf7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.819829] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f4f2724-2797-4f45-af0a-70219c8cf7de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.179698] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.179698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.179698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.179698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.179698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.180190] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 is going to be updated. [ 797.181101] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.181233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.181270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.181443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.181522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.181641] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 797.211413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.211600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.211642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.212156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.212156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.213705] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.213810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.213891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.214071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.214223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.225050] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: IN_PROGRESS for 2s [ 797.225716] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 797.342709] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.342847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.342986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.343217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.343336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.343454] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f4f2724-2797-4f45-af0a-70219c8cf7de already deleted. [ 797.344032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f4f2724-2797-4f45-af0a-70219c8cf7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.454582] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: SUCCESS [ 797.454582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.454582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.454582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.455383] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.455383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.455383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.455383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.455383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.455383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.455585] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.457902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.457902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.457902] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.457902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.457902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.457902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.457902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.457902] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.752576] env[65678]: INFO networking_nsxv3.common.synchronization [req-8f7787bf-507e-4206-80c3-58c3481763c8 req-d1fede16-7289-48ef-90da-168a559d5cfb tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 797.753575] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 797.753575] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.753758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.753758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.753950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.754142] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.754236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.754295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.754446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.754528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.754655] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.769178] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 in Status: SUCCESS [ 797.770187] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 deletion is rescheduled due to dependency. [ 797.770187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8fce09-ff14-4f78-bcad-d1a722c00977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.958896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.959249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.959569] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.117594] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: SUCCESS [ 798.117856] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.118176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.118314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.118516] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.118645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.118705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.118863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.119254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.119254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.119254] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.188557] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.188909] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.188909] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.189546] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.189832] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.189990] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.191145] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.191145] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.191145] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.191145] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.191145] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.191145] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.191456] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.191456] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 798.191456] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.191714] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.212566] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.212566] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 798.212771] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.213135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.213570] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-1721dbc4-d02a-4e12-8ef5-42cc7282e700 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.213873] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-1721dbc4-d02a-4e12-8ef5-42cc7282e700" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.214110] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-1721dbc4-d02a-4e12-8ef5-42cc7282e700" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.214480] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-1721dbc4-d02a-4e12-8ef5-42cc7282e700" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.214656] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1721dbc4-d02a-4e12-8ef5-42cc7282e700',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.258598] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.258789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.258833] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.259074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.282070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.282352] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.282514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.282581] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.282816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.282984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.283127] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 798.315297] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.315571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.315571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.315691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.315898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.324920] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 798.462260] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.621544] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.621749] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.621834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.622059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.622308] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.622460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.622460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.622634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.622724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.622816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.623020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.623157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.623215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.623332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.623473] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.623595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.623673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.623760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.623835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.623933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.624630] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.716683] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.716913] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.717050] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.717358] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.717512] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.718108] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 1721dbc4-d02a-4e12-8ef5-42cc7282e700 not found, creating... [ 798.718108] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.718108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.718286] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.718387] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.718536] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.718778] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.719198] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.719198] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.719287] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.719390] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.720085] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 1721dbc4-d02a-4e12-8ef5-42cc7282e700 is going to be created. [ 798.741403] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.741626] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.741750] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.742048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.742294] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.743135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-1721dbc4-d02a-4e12-8ef5-42cc7282e700" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.964320] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.964493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.964566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.964794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.964887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.965037] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be updated. [ 799.004271] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.004447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.004447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.004726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.005265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.021360] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: IN_PROGRESS for 2s [ 799.127508] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2164111b-0060-40e2-86c3-edfc4931cb24: rpc.has_security_group_logging(os_id): False [ 799.149101] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.149351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.149464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.149753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.149882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.150872] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.150872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.150872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.150872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.150872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.151347] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.151347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.151434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.151668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.151796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.152041] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.152195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.152294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.152480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.152601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.152725] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2164111b-0060-40e2-86c3-edfc4931cb24 is going to be created. [ 799.232341] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.232809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.232809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.233087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.234692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.251526] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: SUCCESS [ 799.251526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.251526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.251733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.252811] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.252811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.252811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.252811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.252811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.252811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.252811] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.259111] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 799.259111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.259111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.259111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.259659] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.259752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.259892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.260158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.260287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.260389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.260502] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.264538] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: IN_PROGRESS for 2s [ 799.554863] env[65678]: INFO networking_nsxv3.common.synchronization [req-8f7787bf-507e-4206-80c3-58c3481763c8 req-d135715d-2f67-4ed4-8452-6a770332fa44 service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 799.555061] env[65678]: INFO networking_nsxv3.common.synchronization [req-8f7787bf-507e-4206-80c3-58c3481763c8 req-d135715d-2f67-4ed4-8452-6a770332fa44 service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 799.555239] env[65678]: INFO networking_nsxv3.common.synchronization [req-8f7787bf-507e-4206-80c3-58c3481763c8 req-d135715d-2f67-4ed4-8452-6a770332fa44 service nova] Enqueued Resource ID: 1721dbc4-d02a-4e12-8ef5-42cc7282e700 with Priority: HIGHEST for action port [ 799.556114] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 799.556114] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 799.556114] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1721dbc4-d02a-4e12-8ef5-42cc7282e700 with Priority: HIGHEST for action port [ 799.557942] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.557942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.557942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.557942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.557942] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.559302] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.559471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.559634] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-1721dbc4-d02a-4e12-8ef5-42cc7282e700 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.559735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1721dbc4-d02a-4e12-8ef5-42cc7282e700" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.559803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1721dbc4-d02a-4e12-8ef5-42cc7282e700" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.561353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1721dbc4-d02a-4e12-8ef5-42cc7282e700" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.561353] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1721dbc4-d02a-4e12-8ef5-42cc7282e700',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.699583] env[65678]: INFO networking_nsxv3.common.synchronization [None req-25bc4054-567d-41b6-95c7-fcb8651b427f tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_rules [ 799.700322] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_rules [ 799.700704] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcfce19-b3dc-46b9-a272-88acde866ff3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.700944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.701060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.701337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.701446] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.755770] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.764936] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.764936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.764936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.765184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.765347] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.765561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.765561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.765692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.765754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.765825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.766553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.766553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.766553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.766553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.766553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.766553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.766553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.766899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.766899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.766899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.766899] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.907743] env[65678]: INFO networking_nsxv3.common.synchronization [None req-c5bffcc0-df02-4996-be63-e3fe55366909 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_rules [ 799.907743] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_rules [ 799.907743] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcfce19-b3dc-46b9-a272-88acde866ff3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.907743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.061112] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.061112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.067209] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1721dbc4-d02a-4e12-8ef5-42cc7282e700 with status ACTIVE [ 800.067209] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.067209] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.067209] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.067209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.067209] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1721dbc4-d02a-4e12-8ef5-42cc7282e700 is going to be updated. [ 800.090112] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.091416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.091505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.091712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.091860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.092044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1721dbc4-d02a-4e12-8ef5-42cc7282e700" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.240616] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.241045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.241045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.241172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.241283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.241400] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 already deleted. [ 800.241799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.241799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.241946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.241946] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.258544] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cf83cc4-cb38-45ef-a793-74322cc1b712: rpc.has_security_group_logging(os_id): False [ 800.269325] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393a6f14-3ce6-441b-a403-1993c47b58e3: rpc.has_security_group_logging(os_id): False [ 800.294268] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.294419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.294492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.294711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.294800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.295045] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.295148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.295212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.295364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.295437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.295526] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 is going to be created. [ 800.301643] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.301846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.301918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.302137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.337229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.337577] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.337746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.337841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.338105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.338224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.338455] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.338581] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.338672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.338871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.338973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.339216] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.339340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.339429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.339692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.339692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.339833] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 800.343824] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 800.343996] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d deletion is rescheduled due to dependency. [ 800.344130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.344646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.344830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.344992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.345146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.345189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.345328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.345405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.345496] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.367897] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.368088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.368129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.368353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.368530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.381047] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: IN_PROGRESS for 2s [ 800.420125] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.420312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.420381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.420638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.420791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.467619] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 800.772709] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.772709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.772994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.775244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.775244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.775244] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 already deleted. [ 800.775244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.848255] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.922161] env[65678]: INFO networking_nsxv3.common.synchronization [req-6c4c4afe-47f2-40c2-bc6e-03c05c0083c7 req-791c8db8-1634-4b82-b870-74d2279aec43 tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 800.922911] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 800.923472] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.923672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.923788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.924040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.924338] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.924979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.925209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.925567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.925687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.925799] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.034044] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: SUCCESS [ 801.034295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.034479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.034709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.034913] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.035087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.035156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.035659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.035766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.035875] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.199909] env[65678]: INFO networking_nsxv3.common.synchronization [req-6c4c4afe-47f2-40c2-bc6e-03c05c0083c7 req-fa7c3f07-5e74-4cb3-82b7-fa5ebd90e25a tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 801.200745] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 801.202534] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.202652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.276685] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: SUCCESS [ 801.277018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.351314] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.394877] env[65678]: INFO networking_nsxv3.common.synchronization [req-6c4c4afe-47f2-40c2-bc6e-03c05c0083c7 req-bf20329c-be8e-4a36-bf2c-5b421fb35ba5 tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 801.395562] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 801.395852] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.395961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.428150] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.538857] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.855830] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.856052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.856052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.856345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.856504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.856618] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 801.898092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.898313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.898496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.898729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.898932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.914604] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 801.931425] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.042347] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.393058] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: SUCCESS [ 802.393409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.435983] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.435983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.435983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.435983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.435983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.435983] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 802.466193] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.467477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.469477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.469477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.469477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.480132] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 802.487842] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 802.487913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.546712] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.546878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.546962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.547295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.547390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.547493] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be updated. [ 802.579963] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.580086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.580187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.580370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.580522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.592957] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: IN_PROGRESS for 2s [ 803.930065] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 803.930507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.930507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.930810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.930972] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.931124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.931192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.931336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.931420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.931570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.931675] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.434896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.435051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.435141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.435531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.435797] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.435933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.435999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.436201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.436321] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.436469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.436635] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.436748] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.436882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.437322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.437500] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.437604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.437661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.437865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.437950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.438086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.438229] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.492524] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 804.492920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.493276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.493492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.493796] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.493980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.494057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.494241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.494365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.494478] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.611163] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: SUCCESS [ 804.611390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.611653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.612210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.612210] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.612210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.612210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.612775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.612775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.612775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.612775] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.612775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.613257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.613257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.613257] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.613257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.613605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.613605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.613605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.613605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.613936] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.645729] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: ee3939d8-8af4-46a5-8af5-ef6791799429 with Priority: HIGHEST for action security_group_members [ 804.645917] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 804.646022] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 804.648317] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee3939d8-8af4-46a5-8af5-ef6791799429 with Priority: HIGHEST for action security_group_members [ 804.648317] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 804.648317] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 804.648317] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee3939d8-8af4-46a5-8af5-ef6791799429 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.648317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.649619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.649619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.649619] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.649619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.649619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.649619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.649619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.649619] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.652508] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.652508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.654163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.654163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.654163] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.654163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.654163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.654163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.654163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.654163] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.654467] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.654624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.654691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.654852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.655012] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.655755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.655755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.655755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.655755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.655755] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.760722] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_rules [ 804.761752] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 804.761934] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 804.762102] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 804.762276] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: ee3939d8-8af4-46a5-8af5-ef6791799429 with Priority: HIGHEST for action security_group_rules [ 804.762364] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: ee3939d8-8af4-46a5-8af5-ef6791799429 with Priority: HIGHEST for action security_group_members [ 804.762490] env[65678]: INFO networking_nsxv3.common.synchronization [req-6589ada6-62ea-4b35-b677-b16e11044c1f req-407b95c9-ff24-4d5d-91eb-74427ea862e6 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 with Priority: HIGHEST for action port [ 804.763124] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_rules [ 804.763293] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_rules [ 804.763409] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee3939d8-8af4-46a5-8af5-ef6791799429 with Priority: HIGHEST for action security_group_members [ 804.763501] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 with Priority: HIGHEST for action port [ 804.763635] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee3939d8-8af4-46a5-8af5-ef6791799429 with Priority: HIGHEST for action security_group_rules [ 804.763732] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 804.763823] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 804.764183] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.764313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.764377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.764681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.764766] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.765720] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.765794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.766609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.766609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.766609] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.767156] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee3939d8-8af4-46a5-8af5-ef6791799429 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.768109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.768109] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.768109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.768109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.768109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.768109] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae37f90-2841-4cff-a9d7-bbd8d5aa4987',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.768974] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee3939d8-8af4-46a5-8af5-ef6791799429 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.769075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.769154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.769418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.769491] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.770786] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.770902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.772181] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.772181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.942403] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d: rpc.has_security_group_logging(os_id): False [ 804.964153] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.964336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.964336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.965620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.965620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.965620] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.965620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.965620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.965620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.965620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.965620] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.965620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.965620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.966271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.966271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.966271] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.966271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.966271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.966507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.966507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.966507] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 804.997546] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.997546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.997546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.997546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.021457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.021696] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.021789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.021926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.024679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.024679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.024679] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 805.058916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.059162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.059240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.059414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.059610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.079539] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 805.086278] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.086278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.086278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.086278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.086278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.116356] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 805.116786] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 634f27f8-e5b0-4d71-84ce-45af2c1641e2: rpc.has_security_group_logging(os_id): False [ 805.158394] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.159613] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.163394] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.175852] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.176056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.177010] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.177010] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.213673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.214152] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.214152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.214152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.214510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.214510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.214736] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.214886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.214989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.215180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.215411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.215411] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.215603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.215603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.215715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.215715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.215831] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be updated. [ 805.272629] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.272828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.273254] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.273254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.273417] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dae37f90-2841-4cff-a9d7-bbd8d5aa4987 with status ACTIVE [ 805.273572] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.273678] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.273743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.273991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.274104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.274286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.274386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.274449] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.274611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.274686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.274867] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.274970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.275096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.275311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.275416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.275550] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dae37f90-2841-4cff-a9d7-bbd8d5aa4987 is going to be updated. [ 805.283826] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee3939d8-8af4-46a5-8af5-ef6791799429 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.284147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.348250] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.348401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.348470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.348699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.348836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.349010] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dae37f90-2841-4cff-a9d7-bbd8d5aa4987" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.377774] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.377945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.378062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.378375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.378375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.414863] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: IN_PROGRESS for 2s [ 805.437308] env[65678]: INFO networking_nsxv3.common.synchronization [req-80253399-ec91-44bc-bde7-cbb9e561b184 req-721284b4-b7cd-46f3-a29f-d3c49083b5dd tempest-ServersNegativeTestMultiTenantJSON-704972286 tempest-ServersNegativeTestMultiTenantJSON-704972286-project-member] Enqueued Resource ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a with Priority: HIGHEST for action security_group_members [ 805.437308] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a with Priority: HIGHEST for action security_group_members [ 805.439444] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d58c068-3cf0-4038-b60f-b9591e0abf8a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.439657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.439728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.440033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.440264] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.440381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.440446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.440622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.440732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.440843] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d58c068-3cf0-4038-b60f-b9591e0abf8a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.662405] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.663554] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.666656] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.943802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.944183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.944183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.944359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.944445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.944883] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.945037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.945111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.945297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.945376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.945468] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a already deleted. [ 805.946012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.972792] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-185 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.972792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-185" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.973185] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-185" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.973540] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-185" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.973659] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.974181] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.974181] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.974355] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.974488] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.974739] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.974858] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.974993] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.975130] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.975568] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.975568] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.975658] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.000131] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.000413] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 806.000610] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.001533] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-185" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.001533] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-d3801461-d843-4cb6-84e0-87f834e5f7de taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.001864] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-d3801461-d843-4cb6-84e0-87f834e5f7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.001864] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-d3801461-d843-4cb6-84e0-87f834e5f7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.002264] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-d3801461-d843-4cb6-84e0-87f834e5f7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.002479] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3801461-d843-4cb6-84e0-87f834e5f7de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.165601] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.165796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.165841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.166061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.166155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.166254] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee3939d8-8af4-46a5-8af5-ef6791799429 is going to be created. [ 806.167732] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.168101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.168218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.168435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.168528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.168625] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 806.169876] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.170008] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.170087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.170270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.170374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.170470] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 is going to be updated. [ 806.204053] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.204216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.204288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.204505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.204664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.223285] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee3939d8-8af4-46a5-8af5-ef6791799429 in Status: UNINITIALIZED for 2s [ 806.234244] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.234417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.234775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.234775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.234935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.237607] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.237740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.237813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.237996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.238233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.253408] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: IN_PROGRESS for 2s [ 806.254227] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 806.505795] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.506025] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.506165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.506457] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.506583] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.506738] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port d3801461-d843-4cb6-84e0-87f834e5f7de not found, creating... [ 806.506994] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.507169] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.507283] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.507499] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.507630] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.507900] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.508102] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.508217] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.508419] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.508548] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.508680] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: d3801461-d843-4cb6-84e0-87f834e5f7de is going to be created. [ 806.528985] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.529245] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.529433] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.529739] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.529933] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.530168] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-d3801461-d843-4cb6-84e0-87f834e5f7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.094520] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 807.094805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.130558] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 807.133020] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d deletion is rescheduled due to dependency. [ 807.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.133020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.133020] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.266486] env[65678]: INFO networking_nsxv3.common.synchronization [req-80253399-ec91-44bc-bde7-cbb9e561b184 req-b8a00d32-e5d9-4c00-a309-8b1df4354c8a service nova] Enqueued Resource ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a with Priority: HIGHEST for action security_group_rules [ 807.266784] env[65678]: INFO networking_nsxv3.common.synchronization [req-80253399-ec91-44bc-bde7-cbb9e561b184 req-b8a00d32-e5d9-4c00-a309-8b1df4354c8a service nova] Enqueued Resource ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a with Priority: HIGHEST for action security_group_members [ 807.266880] env[65678]: INFO networking_nsxv3.common.synchronization [req-80253399-ec91-44bc-bde7-cbb9e561b184 req-b8a00d32-e5d9-4c00-a309-8b1df4354c8a service nova] Enqueued Resource ID: d3801461-d843-4cb6-84e0-87f834e5f7de with Priority: HIGHEST for action port [ 807.267502] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a with Priority: HIGHEST for action security_group_rules [ 807.271049] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a with Priority: HIGHEST for action security_group_members [ 807.271211] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3801461-d843-4cb6-84e0-87f834e5f7de with Priority: HIGHEST for action port [ 807.271551] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d58c068-3cf0-4038-b60f-b9591e0abf8a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.271674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.271727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.272698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.272698] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d58c068-3cf0-4038-b60f-b9591e0abf8a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.273807] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d58c068-3cf0-4038-b60f-b9591e0abf8a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.273928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.274020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.274225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.274370] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.274462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.274521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.274657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.275133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.275195] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d58c068-3cf0-4038-b60f-b9591e0abf8a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.277049] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3801461-d843-4cb6-84e0-87f834e5f7de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.277416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3801461-d843-4cb6-84e0-87f834e5f7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.277416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3801461-d843-4cb6-84e0-87f834e5f7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.277416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3801461-d843-4cb6-84e0-87f834e5f7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.277515] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3801461-d843-4cb6-84e0-87f834e5f7de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.378507] env[65678]: INFO networking_nsxv3.common.synchronization [req-ffb24ace-7920-4361-ac6d-f6d319cd97ed req-74b30edc-cf3e-4c29-9690-4b97f879c0a6 tempest-ServersWithSpecificFlavorTestJSON-1798572525 tempest-ServersWithSpecificFlavorTestJSON-1798572525-project-member] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 807.378908] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 807.379416] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.379416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.379584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.379641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.379787] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.379883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.379947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.380118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.380204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.380300] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.433454] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: SUCCESS [ 807.433454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.433454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.433454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.433454] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.623044] env[65678]: INFO networking_nsxv3.common.synchronization [req-9728371b-af4d-49b9-ab06-cd228b1352ea req-9c46aa61-1d94-492c-82a5-528a10835347 tempest-ServerRescueTestJSONUnderV235-920591361 tempest-ServerRescueTestJSONUnderV235-920591361-project-member] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 807.624079] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGHEST for action security_group_members [ 807.624337] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.624463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.624527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.624745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.624895] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.624990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.625069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.625268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.625365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.625459] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.636604] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.636745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.636813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.637057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.637120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.638559] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.638559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.638559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.638559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.638559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.638559] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 807.678242] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.678575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.678575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.679531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.679744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.690494] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 807.779941] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d58c068-3cf0-4038-b60f-b9591e0abf8a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.782810] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d58c068-3cf0-4038-b60f-b9591e0abf8a taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.783011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.783208] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3801461-d843-4cb6-84e0-87f834e5f7de with status ACTIVE [ 807.783378] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.783475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.783624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.783815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.783893] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.785139] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.785139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.785139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.785139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.785139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.785139] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.785139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.785139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.785139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.785139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.785139] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3801461-d843-4cb6-84e0-87f834e5f7de is going to be updated. [ 807.809308] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.809464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.809768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.810168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.810212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.810518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3801461-d843-4cb6-84e0-87f834e5f7de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.882464] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.882653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.882695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.883125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.925193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.925639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.926025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.926134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.926350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.926435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.926531] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d6ddb-7487-401b-862b-e16865015657 is going to be updated. [ 807.936043] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.936145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.975979] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.976239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.976314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.976527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.976663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.987781] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: IN_PROGRESS for 2s [ 808.127691] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.127997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.127997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.128152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.128239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.129036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.129036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.129036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.129036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.129036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.129036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be updated. [ 808.168300] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.168443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.169101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.169101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.169218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.179978] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: IN_PROGRESS for 2s [ 808.234112] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee3939d8-8af4-46a5-8af5-ef6791799429 in Status: UNINITIALIZED for 4s [ 808.273452] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 808.273749] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.274080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.274207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.274373] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.274488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.274556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.274711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.274795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.274957] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.276598] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: SUCCESS [ 808.276791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.276939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.277133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.277310] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.277744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.277744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.277744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.277956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.278086] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.283765] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d58c068-3cf0-4038-b60f-b9591e0abf8a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.780319] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.781243] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.787189] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.787404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.787530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.787809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.787913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.788085] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a is going to be created. [ 808.818682] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.818682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.818682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.819015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.819210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.835871] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a in Status: UNINITIALIZED for 2s [ 809.284631] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.285446] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.701733] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 809.701945] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d deletion is rescheduled due to dependency. [ 809.702133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.787966] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.787966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.787966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.788396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.788465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.788785] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 809.790149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.791020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.791020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.791020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.791020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.791020] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 is going to be updated. [ 809.826032] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.826336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.826336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.826473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.826636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.828508] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.828642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.828695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.829563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.829563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.841324] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: IN_PROGRESS for 2s [ 809.841324] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 809.998642] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: SUCCESS [ 809.998880] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d6ddb-7487-401b-862b-e16865015657 deletion is rescheduled due to dependency. [ 810.000125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.194203] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: SUCCESS [ 810.194439] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 deletion is rescheduled due to dependency. [ 810.194596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.194840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.195186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.195488] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.195676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.195780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.196032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.196167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.196310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.196458] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.247616] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee3939d8-8af4-46a5-8af5-ef6791799429 in Status: SUCCESS [ 810.247891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.248055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.248292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.248494] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.248901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.248901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.248992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.248992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.249105] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.699523] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.699966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.699966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.700226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.700460] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.700608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.700700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.700915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.701202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.701424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.701578] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.701709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.701794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.701989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.702202] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.702346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.702437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.702658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.702802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.702938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.703106] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.751992] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.847553] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a in Status: SUCCESS [ 810.847831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.848038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.848182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.848390] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.848524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.848575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.848699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.849403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.849403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.849403] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d58c068-3cf0-4038-b60f-b9591e0abf8a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.206865] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 634f27f8-e5b0-4d71-84ce-45af2c1641e2: rpc.has_security_group_logging(os_id): False [ 811.234341] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.234440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.234440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.235369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.235369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.235369] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.235369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.235369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.235369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.235369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.235651] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.235651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.235785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.235834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.235914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.236459] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.236459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.236459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.236459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.236635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.236635] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be updated. [ 811.254191] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.313168] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.313368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.313420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.313637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.313764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.348611] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: IN_PROGRESS for 2s [ 811.352541] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d58c068-3cf0-4038-b60f-b9591e0abf8a taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.354046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.354046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.354046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.354046] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.354046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.354046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.354046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.354046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.354493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.354803] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d58c068-3cf0-4038-b60f-b9591e0abf8a taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.355186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.355376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.355652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.355948] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.356184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.356335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.356589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.357031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.357031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.357031] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d58c068-3cf0-4038-b60f-b9591e0abf8a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.462591] env[65678]: INFO networking_nsxv3.common.synchronization [req-8c6f4edf-dab8-478d-a746-0c122e261ef8 req-3b41a6d8-3f7e-4ae6-9962-4a9cfba11c35 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 811.462591] env[65678]: INFO networking_nsxv3.common.synchronization [req-8c6f4edf-dab8-478d-a746-0c122e261ef8 req-3b41a6d8-3f7e-4ae6-9962-4a9cfba11c35 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 811.462742] env[65678]: INFO networking_nsxv3.common.synchronization [req-8c6f4edf-dab8-478d-a746-0c122e261ef8 req-3b41a6d8-3f7e-4ae6-9962-4a9cfba11c35 tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: ee3939d8-8af4-46a5-8af5-ef6791799429 with Priority: HIGHEST for action security_group_members [ 811.463328] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGHEST for action security_group_members [ 811.463488] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 811.464306] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee3939d8-8af4-46a5-8af5-ef6791799429 with Priority: HIGHEST for action security_group_members [ 811.464306] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.464306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.464306] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.464612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.464612] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee3939d8-8af4-46a5-8af5-ef6791799429 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.464612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.758123] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.758510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.758510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.758510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.758680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.758680] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee3939d8-8af4-46a5-8af5-ef6791799429 is going to be updated. [ 811.796604] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.796880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.796994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.797329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.797714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.814842] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee3939d8-8af4-46a5-8af5-ef6791799429 in Status: IN_PROGRESS for 2s [ 811.859033] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 811.859603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.859900] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d58c068-3cf0-4038-b60f-b9591e0abf8a: rpc.has_security_group_logging(os_id): False [ 811.862349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.862723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.863012] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.863221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.863399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.863620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.863782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.864371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.864371] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.865870] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: SUCCESS [ 811.866094] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.866423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.866652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.866652] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.866908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.866908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.867150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.867150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.867282] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.868092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.868344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.868509] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.868691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.868760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.868922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.869028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.869122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.869235] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.870835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.871030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.871220] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.871354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.871615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.871615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.871615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.872226] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.893350] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.893603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.893724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.895166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.895166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.895166] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.895166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.895166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.895166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.895166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.896283] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.896283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.896283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.896283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.896283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.896283] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.896283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.896283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.896283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.896811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.896811] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a is going to be created. [ 811.903834] env[65678]: INFO networking_nsxv3.common.synchronization [req-c99d48d7-f4e4-4b76-9c5a-cfbad7d5f55c req-90fdb4d3-6aaf-470f-9f2a-39fdba6ae35b tempest-ListServerFiltersTestJSON-129772598 tempest-ListServerFiltersTestJSON-129772598-project-member] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 811.904818] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 811.905386] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.906251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.906251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.906251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.906251] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.906486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.906486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.907598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.907598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.907598] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.977220] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.977411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.977456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.977667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.977895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.992976] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a in Status: IN_PROGRESS for 2s [ 812.371523] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.371835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.373280] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.374227] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.375983] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.376367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.376652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.376918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.377032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.377420] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.377420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.377420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.377952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.378103] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.378232] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 is going to be updated. [ 812.411107] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.411259] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.411326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.411534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.411664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.413560] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.427920] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: IN_PROGRESS for 2s [ 812.876914] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cf83cc4-cb38-45ef-a793-74322cc1b712: rpc.has_security_group_logging(os_id): False [ 812.882060] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.910147] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.910479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.910664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.911059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.911277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.911840] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.911969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.912284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.912518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.912635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.912759] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 is going to be updated. [ 812.918110] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.980788] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.980788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.980788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.980788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.980788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.999145] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: IN_PROGRESS for 2s [ 813.363028] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 in Status: SUCCESS [ 813.363644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.387921] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.388737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.388880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.389445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.389686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.389686] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 813.420720] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.420912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.421040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.421273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.421400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.421453] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be updated. [ 813.428446] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.428611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.428779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.428847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.428984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.439959] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 813.458564] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.458925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.459378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.459378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.460548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.471276] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 813.687756] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.687918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.687989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.688264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.688375] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.829899] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee3939d8-8af4-46a5-8af5-ef6791799429 in Status: SUCCESS [ 813.830130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.830766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.830766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.830924] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.831013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.831118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.831413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.831528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.831651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.831786] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.832924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.833125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.833342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.833473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.833603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.833714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.834548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.834548] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.005303] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a in Status: SUCCESS [ 814.005575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.192687] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.337674] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee3939d8-8af4-46a5-8af5-ef6791799429',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.338817] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.338941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.338980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.339208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.339304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.339558] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.339675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.339738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.339904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.340167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.340167] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee3939d8-8af4-46a5-8af5-ef6791799429 is going to be deleted. [ 814.371872] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.371872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.371872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.371872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.371872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.371872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.439384] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: SUCCESS [ 814.439632] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 deletion is rescheduled due to dependency. [ 814.439772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.694893] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.841537] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee3939d8-8af4-46a5-8af5-ef6791799429: rpc.has_security_group_logging(os_id): False [ 814.862569] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.862569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.862569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.862569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.862569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.863221] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.863221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.863221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.863422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.863422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.863536] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee3939d8-8af4-46a5-8af5-ef6791799429 is going to be created. [ 814.883126] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ee3939d8-8af4-46a5-8af5-ef6791799429], does not exist path=[/infra/domains/default/groups/ee3939d8-8af4-46a5-8af5-ef6791799429]."\n}' [ 814.883250] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee3939d8-8af4-46a5-8af5-ef6791799429 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ee3939d8-8af4-46a5-8af5-ef6791799429 [ 814.883321] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 814.929324] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.929573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.929628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.929834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.930997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.931295] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.931518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.931518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.931693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.931777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.932230] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.932356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.932396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.932579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.932662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.932760] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee3939d8-8af4-46a5-8af5-ef6791799429 is going to be created. [ 814.954642] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ee3939d8-8af4-46a5-8af5-ef6791799429], does not exist path=[/infra/domains/default/groups/ee3939d8-8af4-46a5-8af5-ef6791799429]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ee3939d8-8af4-46a5-8af5-ef6791799429 [ 814.954642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee3939d8-8af4-46a5-8af5-ef6791799429" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.954844] env[65678]: Traceback (most recent call last): [ 814.954844] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 814.954844] env[65678]: return func(*args, **kwargs) [ 814.954844] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 814.954844] env[65678]: res.raise_for_status() [ 814.954844] env[65678]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 814.954844] env[65678]: raise HTTPError(http_error_msg, response=self) [ 814.954844] env[65678]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ee3939d8-8af4-46a5-8af5-ef6791799429 [ 814.954844] env[65678]: During handling of the above exception, another exception occurred: [ 814.954844] env[65678]: Traceback (most recent call last): [ 814.954844] env[65678]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 814.954844] env[65678]: listener.cb(fileno) [ 814.954844] env[65678]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 814.954844] env[65678]: result = function(*args, **kwargs) [ 814.954844] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 814.954844] env[65678]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 814.954844] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 814.954844] env[65678]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 814.954844] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 814.954844] env[65678]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 814.954844] env[65678]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 814.954844] env[65678]: res.raise_for_status() [ 814.954844] env[65678]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 814.954844] env[65678]: raise HTTPError(http_error_msg, response=self) [ 814.954844] env[65678]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ee3939d8-8af4-46a5-8af5-ef6791799429 [ 814.954844] env[65678]: Removing descriptor: 16 [ 815.015816] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 in Status: SUCCESS [ 815.016190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.197868] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 815.197961] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 815.450517] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 815.450517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.450671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.450943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.451144] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.451427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.451427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.451507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.451537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.451616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.451765] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.451857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.451919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.452072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.452208] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.452293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.452352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.452484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.452556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.452633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.452720] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.483025] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 815.483201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.955953] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393a6f14-3ce6-441b-a403-1993c47b58e3: rpc.has_security_group_logging(os_id): False [ 815.974380] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.974638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.974638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.974869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.979115] env[65678]: INFO networking_nsxv3.common.synchronization [req-37a40bd0-4e49-4e01-9bb1-13f461fe9aa5 req-6bce9b5e-cc3f-49c1-86bf-823f0889ccf0 tempest-ServerMetadataTestJSON-1119160030 tempest-ServerMetadataTestJSON-1119160030-project-member] Enqueued Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGHEST for action security_group_members [ 815.979357] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGHEST for action security_group_members [ 815.979652] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.979767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.979834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.980039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.980356] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.980476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.980556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.980924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.981253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.981394] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95d8bedd-dc94-41cb-aa04-1d71595ff0bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.011317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.011902] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.012155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.012308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.012625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.014601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.014601] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.014601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.014601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.014601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.014601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.014601] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.014601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.014601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.014601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.015234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.015462] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 816.095472] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.095752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.095752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.095872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.096655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.116465] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 816.476100] env[65678]: INFO networking_nsxv3.common.synchronization [None req-2f01143a-6828-410c-bf95-f4f7e6221dd6 tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_rules [ 816.478775] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_rules [ 816.479451] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3b380ca-ae52-4449-89ca-b2e647b635d9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.479593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.479683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.479951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.481629] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.483185] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.483185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.483346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.483396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.506870] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.506870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.506870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.506870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.523193] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 816.524170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.525637] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 816.528033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.528250] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.528366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.528987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.528987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.528987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.528987] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf is going to be updated. [ 816.568730] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.568906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.568968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.569355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.576220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.576938] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 816.577046] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.577046] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 816.578914] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.579090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.579165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.580049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.580049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.595945] env[65678]: INFO networking_nsxv3.common.synchronization [None req-ddec415b-7ceb-489b-99e4-3066227949cf tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_rules [ 816.597126] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf in Status: IN_PROGRESS for 2s [ 816.597663] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_rules [ 816.597984] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3b380ca-ae52-4449-89ca-b2e647b635d9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.599020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.629812] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.629812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.630038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.630123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.631298] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.631298] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 816.730772] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.730996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.731089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.731364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.731614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.731856] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 816.812091] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.812309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.812387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.812601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.812836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.813843] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 816.813991] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'02e933d1-ac0d-4baa-9da0-e149762ce926', 'eb02d1eb-8ee4-47ad-b890-95d76e24df1b', '9387d345-5efc-43c7-9adb-0d5c075e3136', 'c54cf5e6-150a-4668-bddb-ef25e038e5cf', 'e9844dc2-a792-4762-9b70-e918899f67f5', 'e24b48ad-1ed5-4566-912b-a63687a8de4d', '95d8bedd-dc94-41cb-aa04-1d71595ff0bf', '9497cc12-615a-4090-934d-a1b00059825f', 'c8c37326-10eb-4f55-9c8c-9fa3df34ae9e', '9a4a38bf-eedc-4528-b75b-a6d281d9d8db', '01a87ef9-be93-4585-b9c3-7d62b4b2fe0c', 'dc7f6218-60a3-4bd3-9819-6777964d3718', 'e72b3b22-43b8-43bc-86bc-e0360d10d8e5', '6d86ff68-550b-40c3-8567-854372ec34de', 'b98b8977-5505-4665-ad19-ac6d8455a014', 'd8085af0-0afc-45eb-a26a-73aa0c8599a4', '634f27f8-e5b0-4d71-84ce-45af2c1641e2', 'f6eb745b-f38e-4b8f-9261-fe65a6934037', '393a6f14-3ce6-441b-a403-1993c47b58e3', 'f46c3f3e-0eeb-4c56-8053-6f8baff61565', '4d6db365-2384-4e4f-98b7-13262fcd05f8', '961e8451-f48b-412a-8046-631c24d72fe5', '433d6ddb-7487-401b-862b-e16865015657', '5ad6310b-73d1-441e-897d-b412b1e437a2', '6ed86dd0-f355-4dc0-9bd4-91be15af4d6d', 'aec1e262-a46a-4ce5-b4f8-1392575d0891', '433b7d9d-3978-4af8-a278-70a89b5d5f2e', '32f35a35-0102-4d28-a65d-3999b6041978', '1cf83cc4-cb38-45ef-a793-74322cc1b712', 'd196335c-3d4b-49d3-91d2-49ab0c720654', 'abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb', 'be3b7ec3-66f8-4175-9611-636d9a427a3e', 'e857e4d2-27dd-462e-87df-ee44911ff684', '850ea458-7bc9-41b1-87fe-f961a64609eb', '6f8fce09-ff14-4f78-bcad-d1a722c00977', '394e9a35-6053-4366-8c10-efbb3bbed0b9', '2164111b-0060-40e2-86c3-edfc4931cb24', 'cddb9167-1b9c-4751-8cf3-4f83a593874e', '8631425e-c832-4434-9322-1536d9e46bb8', '40537b9d-ed59-4875-a8af-108e1322d055', 'b634fd1e-f1ec-4189-ac44-9f8fa9578204', '6bf254fe-a02c-4c36-8f89-52a5a801f9b5', '8d58c068-3cf0-4038-b60f-b9591e0abf8a', 'cda39a55-69e8-4fac-bca6-eac8c60627f3'} {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.814144] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 816.834905] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.835205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.835706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.835706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.835981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.835981] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 816.836250] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.836250] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 816.903253] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.903253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.903381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.903590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.904498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.904757] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 816.904838] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.904907] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 816.905036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 816.905036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 816.905153] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGH for action security_group_rules [ 816.905375] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGH for action security_group_rules [ 816.905375] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGH for action security_group_rules [ 816.905375] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGH for action security_group_rules [ 816.905375] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGH for action security_group_rules [ 816.905872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGH for action security_group_rules [ 816.905872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGH for action security_group_rules [ 816.905872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGH for action security_group_rules [ 816.905872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGH for action security_group_rules [ 816.905872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGH for action security_group_rules [ 816.905872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGH for action security_group_rules [ 816.905872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGH for action security_group_rules [ 816.905872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGH for action security_group_rules [ 816.905872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGH for action security_group_rules [ 816.906340] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGH for action security_group_rules [ 816.906340] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGH for action security_group_rules [ 816.906340] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGH for action security_group_rules [ 816.906340] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGH for action security_group_rules [ 816.906340] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGH for action security_group_rules [ 816.906340] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGH for action security_group_rules [ 816.906605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.004508] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.004508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.004508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.004768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.004830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.005033] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 already deleted. [ 817.005129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.005540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.005540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.005540] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.528569] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.529029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.529029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.529252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.529401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.529549] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 already deleted. [ 817.529684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.141877] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 818.142967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.618739] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf in Status: SUCCESS [ 818.618997] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf deletion is rescheduled due to dependency. [ 818.619053] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.397690] env[65678]: INFO networking_nsxv3.common.synchronization [req-859db526-d516-49ad-ae58-8293b3fc99b7 req-d2b778f4-1419-4675-8986-39f5977c3b1c tempest-ServersNegativeTestMultiTenantJSON-704972286 tempest-ServersNegativeTestMultiTenantJSON-704972286-project-member] Enqueued Resource ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a with Priority: HIGHEST for action security_group_members [ 820.398392] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a with Priority: HIGHEST for action security_group_members [ 820.398618] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGH for action security_group_rules [ 820.399062] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 with Priority: HIGH for action security_group_rules [ 820.399413] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf with Priority: HIGH for action security_group_rules [ 820.399567] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b98b8977-5505-4665-ad19-ac6d8455a014 with Priority: HIGH for action security_group_rules [ 820.400248] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 with Priority: HIGH for action security_group_rules [ 820.400364] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGH for action security_group_rules [ 820.400471] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGH for action security_group_rules [ 820.400601] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 with Priority: HIGH for action security_group_rules [ 820.400699] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGH for action security_group_rules [ 820.400790] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 with Priority: HIGH for action security_group_rules [ 820.400910] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGH for action security_group_rules [ 820.401017] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGH for action security_group_rules [ 820.401104] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGH for action security_group_rules [ 820.401305] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db with Priority: HIGH for action security_group_rules [ 820.401443] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e with Priority: HIGH for action security_group_rules [ 820.401534] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGH for action security_group_rules [ 820.401637] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9497cc12-615a-4090-934d-a1b00059825f with Priority: HIGH for action security_group_rules [ 820.401731] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGH for action security_group_rules [ 820.402305] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGH for action security_group_rules [ 820.402439] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf with Priority: HIGH for action security_group_rules [ 820.402738] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d58c068-3cf0-4038-b60f-b9591e0abf8a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.403027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.403027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.403243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.403407] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.403517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.403564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.403713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.403796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.403893] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d58c068-3cf0-4038-b60f-b9591e0abf8a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.405447] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.405579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.405746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.405939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.406037] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.407278] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9387d345-5efc-43c7-9adb-0d5c075e3136 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.407393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.407437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.407743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.407830] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9387d345-5efc-43c7-9adb-0d5c075e3136',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.409097] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.409097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.409097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.409356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.409434] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95d8bedd-dc94-41cb-aa04-1d71595ff0bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.410848] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b98b8977-5505-4665-ad19-ac6d8455a014 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.411437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.411537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.411709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.412089] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b98b8977-5505-4665-ad19-ac6d8455a014',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.414163] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.414163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.414163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.414351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.414563] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f46c3f3e-0eeb-4c56-8053-6f8baff61565',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.415948] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.416091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.416926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.416926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.416926] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.420035] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.420035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.420035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.420035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.420035] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.420035] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.420035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.420035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.420035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.420035] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('634f27f8-e5b0-4d71-84ce-45af2c1641e2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.421837] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.422037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.422100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.422361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.422361] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.423095] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.423201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.423286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.423500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.423592] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8085af0-0afc-45eb-a26a-73aa0c8599a4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.424699] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.424826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.424826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.425015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.425015] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.426014] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.426014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.426014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.426216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.426216] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.427304] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.427406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.427406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.427855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.427855] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.429283] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.429498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.429498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.429964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.429964] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a4a38bf-eedc-4528-b75b-a6d281d9d8db',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.430943] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.431085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.431133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.431299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.431369] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8c37326-10eb-4f55-9c8c-9fa3df34ae9e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.432365] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.432495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.432616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.432869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.432869] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.433971] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9497cc12-615a-4090-934d-a1b00059825f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.433971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.434151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.434151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.434229] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9497cc12-615a-4090-934d-a1b00059825f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.437060] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.437173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.437215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.437339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.437471] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.439574] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.439574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.439574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.439744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.440024] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.440876] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.440978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.441064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.441225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.441298] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c54cf5e6-150a-4668-bddb-ef25e038e5cf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.441642] env[65678]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 820.906600] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.907217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.907744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.907744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.922636] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.922826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.922954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.923796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.923796] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.923796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.923796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.923796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.923796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.924172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.924172] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.935867] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.935982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.945779] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.945917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.947156] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.947424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.947424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.948215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.948215] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.948215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.948215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.948215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.948215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.948215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.948771] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.949205] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.949318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.951031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.951031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.951031] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.951031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.951031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.951031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.951031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.951031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.951031] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.954115] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.954115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.955441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.955633] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.955732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.955839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.956057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.956102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.956182] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a is going to be updated. [ 820.958237] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.958358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.958430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.958618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.961240] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.961350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.962147] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.962244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.965087] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.965220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.965274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.965467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.965658] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.965774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.965839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.966020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.966109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.966196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.966284] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.971957] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.972090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.972090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.972274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.972546] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.972546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.972648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.972695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.972780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.972871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.972978] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.975107] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.975234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.975320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.975572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.975740] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.975880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.975954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.976225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.976330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.976425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.976708] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.983708] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.983851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.984646] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.984741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.987585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.987585] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95d8bedd-dc94-41cb-aa04-1d71595ff0bf is going to be deleted. [ 820.990997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.990997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.007692] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.007857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.007949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.008217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.008372] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.013029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.013029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.014559] env[65678]: INFO networking_nsxv3.common.synchronization [req-c630fa73-21db-4d7b-b1b2-65516a88daff req-4a0787da-f25c-468e-bd33-9b6809f658b8 tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 821.016104] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.016211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.017235] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 821.017235] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.017235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.017235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.017235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.017698] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.017698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.017698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.017698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.017698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.017911] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.020328] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.020425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.021212] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a in Status: IN_PROGRESS for 2s [ 821.022162] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.022278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.023084] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.023213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.024505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.026285] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be deleted. [ 821.026285] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.026598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.026598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.026745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.056287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.056463] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a4a38bf-eedc-4528-b75b-a6d281d9d8db is going to be deleted. [ 821.057623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.057895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.080743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.080743] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9387d345-5efc-43c7-9adb-0d5c075e3136 is going to be deleted. [ 821.081799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.082124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.102126] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.102249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.103099] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.103225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.112671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.112807] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 634f27f8-e5b0-4d71-84ce-45af2c1641e2 is going to be deleted. [ 821.113901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.114173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.158400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.158633] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f46c3f3e-0eeb-4c56-8053-6f8baff61565 is going to be deleted. [ 821.164025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.164025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.181417] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.181610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.226305] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.226305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.237048] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.237197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.238535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.240770] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d86ff68-550b-40c3-8567-854372ec34de is going to be deleted. [ 821.240770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.240986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.299440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.299440] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8085af0-0afc-45eb-a26a-73aa0c8599a4 is going to be deleted. [ 821.299729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.300071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.333968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.334133] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be deleted. [ 821.335153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.335480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.389559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.390127] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8c37326-10eb-4f55-9c8c-9fa3df34ae9e is going to be deleted. [ 821.391150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.391545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.393958] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.394203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.394967] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.395122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.433393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.433752] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be deleted. [ 821.436019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.436019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.436019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.436203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.436377] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.436584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.436684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.436874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.437359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.437567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.437905] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.438143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.438453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.439173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.439173] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.439333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.439454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.439810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.440030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.440249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.441161] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.442147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.442357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.458136] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.458136] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.458136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.458136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.458136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.458136] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.458136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.458136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.458136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.459638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.459638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.459638] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.459638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.459638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.459638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.459638] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.459638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.459638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.459638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.459638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.460468] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.460468] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.463685] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.464821] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.464821] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.464821] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.465000] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.465131] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.465192] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.465433] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.465577] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.465785] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.465968] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.466309] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.466519] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.466726] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.466920] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.468062] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.469666] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.469844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.471658] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.482060] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.482265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.482343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.482533] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.482707] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.482808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.482870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.483158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.483250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.483339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.483532] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.483683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.483766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.483950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.484566] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.484712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.484785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.485114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.485231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.485331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.485474] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.486732] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.493331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.493513] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9497cc12-615a-4090-934d-a1b00059825f is going to be deleted. [ 821.494516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.494812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.519774] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.524057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.532395] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.532588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.544600] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.544776] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.078 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 821.544912] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.545113] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.545489] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-ece8ebab-81db-4c64-b73b-73513f0046b3 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.545693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-ece8ebab-81db-4c64-b73b-73513f0046b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.545863] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-ece8ebab-81db-4c64-b73b-73513f0046b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.546167] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-ece8ebab-81db-4c64-b73b-73513f0046b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.546339] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ece8ebab-81db-4c64-b73b-73513f0046b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.574237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.574382] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c54cf5e6-150a-4668-bddb-ef25e038e5cf is going to be deleted. [ 821.575401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.575636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.606751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.606916] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b98b8977-5505-4665-ad19-ac6d8455a014 is going to be deleted. [ 821.607935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.608201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.608301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.608436] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95d8bedd-dc94-41cb-aa04-1d71595ff0bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.608638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.608830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.608884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.609012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.609619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.609813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.609910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.610051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a4a38bf-eedc-4528-b75b-a6d281d9d8db" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.610225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.610412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.610499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.610630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9387d345-5efc-43c7-9adb-0d5c075e3136" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.610832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.611095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.611346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.611598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-634f27f8-e5b0-4d71-84ce-45af2c1641e2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.612164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.612164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.612164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.612351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.612515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.612728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.612829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.613018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f46c3f3e-0eeb-4c56-8053-6f8baff61565" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.613206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.613379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.613505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.613689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8085af0-0afc-45eb-a26a-73aa0c8599a4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.613861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.614213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.614282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.614582] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.614735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.614865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.615061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.615197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.615343] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 821.616751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.616973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.617075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.617196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.627159] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.627402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.627402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.627605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.627695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.627816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8c37326-10eb-4f55-9c8c-9fa3df34ae9e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.644881] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.645083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.645203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.645537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.645680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.646096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.672726] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.672928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.673089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.673383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.673577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.706900] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.707083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.707167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.707428] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.707555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.707736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9497cc12-615a-4090-934d-a1b00059825f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.708815] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.708958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.709056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.709283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.709400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.709541] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c54cf5e6-150a-4668-bddb-ef25e038e5cf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.710653] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 821.780936] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.781124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.781223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.781520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.781626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.781761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b98b8977-5505-4665-ad19-ac6d8455a014" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.945253] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393a6f14-3ce6-441b-a403-1993c47b58e3: rpc.has_security_group_logging(os_id): False [ 821.962137] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6eb745b-f38e-4b8f-9261-fe65a6934037: rpc.has_security_group_logging(os_id): False [ 821.966068] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.966068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.966068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.966068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.971219] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e72b3b22-43b8-43bc-86bc-e0360d10d8e5: rpc.has_security_group_logging(os_id): False [ 821.976045] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc7f6218-60a3-4bd3-9819-6777964d3718: rpc.has_security_group_logging(os_id): False [ 821.981295] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.981440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.988264] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb02d1eb-8ee4-47ad-b890-95d76e24df1b: rpc.has_security_group_logging(os_id): False [ 821.989513] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9844dc2-a792-4762-9b70-e918899f67f5: rpc.has_security_group_logging(os_id): False [ 821.995841] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.996055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.998769] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.998908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.002397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.002397] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.002397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.002397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.002787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.002787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.002968] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.003090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.003150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.003311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.003385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.003575] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.003662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.003712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.003848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.003939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.004052] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 822.005150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.005329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.014784] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.014978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.017778] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.017882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.028693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.029024] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.029232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.029333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.029562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.030334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.030334] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 is going to be updated. [ 822.030942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.031240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.049196] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.049727] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.049727] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.050403] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.050403] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.050403] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port ece8ebab-81db-4c64-b73b-73513f0046b3 not found, creating... [ 822.050653] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.050873] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.051155] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.051538] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.051746] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.052215] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.052448] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.052578] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.052866] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.053114] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.053305] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: ece8ebab-81db-4c64-b73b-73513f0046b3 is going to be created. [ 822.056433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.056433] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.056433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.056433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.056433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.056433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.056433] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc7f6218-60a3-4bd3-9819-6777964d3718 is going to be updated. [ 822.057454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.057596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.079112] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.079112] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.079112] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.079433] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.083021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.083021] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-ece8ebab-81db-4c64-b73b-73513f0046b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.083021] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.083021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.085919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.086181] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.086299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.086361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.086548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.086631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.086833] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.086934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.086996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.087161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.087504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.087504] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.087504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.087635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.087675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.087795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.087851] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b is going to be updated. [ 822.088974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.089136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.119934] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.120088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.123612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.123996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.124170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.124286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.124451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.124540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.124748] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.124845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.124907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.125126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.125184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.125336] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.125410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.125470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.125606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.125679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.125774] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 is going to be updated. [ 822.126820] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.126993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.127169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.128110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.128386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.148854] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.149041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.166538] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 822.170952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.171163] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.171271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.171332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.171539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.171650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.171722] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 822.172848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.173579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.173963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.175810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.176510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.176696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.215024] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.215024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.215024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.215024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.215024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.218781] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc7f6218-60a3-4bd3-9819-6777964d3718 in Status: IN_PROGRESS for 2s [ 822.228515] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: IN_PROGRESS for 2s [ 822.260920] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: IN_PROGRESS for 2s [ 822.350838] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.351055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.351105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.351385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.351567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.415022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.415225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.415343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.415696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.415959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.433519] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: IN_PROGRESS for 2s [ 822.440141] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 822.822516] env[65678]: INFO networking_nsxv3.common.synchronization [req-c630fa73-21db-4d7b-b1b2-65516a88daff req-1798e586-ff46-4a84-8b17-1cb6a9d80dfb service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 822.822516] env[65678]: INFO networking_nsxv3.common.synchronization [req-c630fa73-21db-4d7b-b1b2-65516a88daff req-1798e586-ff46-4a84-8b17-1cb6a9d80dfb service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 822.822516] env[65678]: INFO networking_nsxv3.common.synchronization [req-c630fa73-21db-4d7b-b1b2-65516a88daff req-1798e586-ff46-4a84-8b17-1cb6a9d80dfb service nova] Enqueued Resource ID: ece8ebab-81db-4c64-b73b-73513f0046b3 with Priority: HIGHEST for action port [ 822.822729] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 822.822830] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 822.822940] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ece8ebab-81db-4c64-b73b-73513f0046b3 with Priority: HIGHEST for action port [ 822.825634] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.825634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.825733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.825934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.826023] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.827214] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.827376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.828113] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ece8ebab-81db-4c64-b73b-73513f0046b3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.828113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ece8ebab-81db-4c64-b73b-73513f0046b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.828254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ece8ebab-81db-4c64-b73b-73513f0046b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.828438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ece8ebab-81db-4c64-b73b-73513f0046b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.828527] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ece8ebab-81db-4c64-b73b-73513f0046b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.034323] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a in Status: SUCCESS [ 823.034540] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d58c068-3cf0-4038-b60f-b9591e0abf8a deletion is rescheduled due to dependency. [ 823.034717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d58c068-3cf0-4038-b60f-b9591e0abf8a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.176320] env[65678]: INFO networking_nsxv3.common.synchronization [req-adff64ec-c4cd-4341-958e-aba2956abdef req-c35e0035-582f-4cdd-97f6-7c730e728cea tempest-VolumesAssistedSnapshotsTest-310453157 tempest-VolumesAssistedSnapshotsTest-310453157-project-member] Enqueued Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_members [ 823.176927] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGHEST for action security_group_members [ 823.177281] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-850ea458-7bc9-41b1-87fe-f961a64609eb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.177459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.177515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.177683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.177843] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.177940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.178021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.178178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.178261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.178351] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('850ea458-7bc9-41b1-87fe-f961a64609eb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.332268] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.332414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.334375] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ece8ebab-81db-4c64-b73b-73513f0046b3 with status ACTIVE [ 823.334375] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.334375] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.334375] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.334375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.335046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.335046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.335046] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ece8ebab-81db-4c64-b73b-73513f0046b3 is going to be updated. [ 823.368260] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.368414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.368482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.368884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.368884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.369059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ece8ebab-81db-4c64-b73b-73513f0046b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.680904] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.680904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.680904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.680904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.705272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.705540] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.705665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.705732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.705948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.706061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.706173] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850ea458-7bc9-41b1-87fe-f961a64609eb is going to be updated. [ 823.722040] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 823.722244] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c deletion is rescheduled due to dependency. [ 823.722355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.722533] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.722768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.722992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.723153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.723216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.723407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.723493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.723593] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.737731] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.737908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.737954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.738232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.738379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.748969] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850ea458-7bc9-41b1-87fe-f961a64609eb in Status: IN_PROGRESS for 2s [ 824.187868] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 824.188117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.226252] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.236223] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc7f6218-60a3-4bd3-9819-6777964d3718 in Status: SUCCESS [ 824.237190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.246085] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: SUCCESS [ 824.246359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.285615] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: SUCCESS [ 824.285750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.451490] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: SUCCESS [ 824.451705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.452760] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 824.452760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.730037] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.231802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.232311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.232426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.232711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.232818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.232991] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 825.265407] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.265630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.265630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.265837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.265981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.276564] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 825.759628] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 850ea458-7bc9-41b1-87fe-f961a64609eb in Status: SUCCESS [ 825.760050] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 850ea458-7bc9-41b1-87fe-f961a64609eb deletion is rescheduled due to dependency. [ 825.760050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-850ea458-7bc9-41b1-87fe-f961a64609eb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.131614] env[65678]: INFO networking_nsxv3.common.synchronization [req-280d2498-d192-4c46-be30-43286db6fdc4 req-60a873f7-043e-48d7-bbe6-4da69e5825df tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_members [ 827.132320] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_members [ 827.132699] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2de4eec-43fc-4180-be46-e291d4587236 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.132866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.133072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.133462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.134367] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.134367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.134367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.134367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.134367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.134367] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.289928] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 827.290297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.290513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.290773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.291022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.291190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.291273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.291474] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.291563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.291659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.291772] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.474854] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.475150] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.475346] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.475606] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.476025] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.476184] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.476302] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.476547] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.476708] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.476907] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.477027] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.477116] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.477229] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.477338] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.477453] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.477585] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.498860] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.499232] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 827.499427] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.499683] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.500022] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-8b56c930-252e-4467-8a7f-58e82cf04fc8 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.500239] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-8b56c930-252e-4467-8a7f-58e82cf04fc8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.500371] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-8b56c930-252e-4467-8a7f-58e82cf04fc8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.500710] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-8b56c930-252e-4467-8a7f-58e82cf04fc8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.500847] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b56c930-252e-4467-8a7f-58e82cf04fc8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.637696] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.637696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.637981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.638102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.638235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.638560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.638660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.638749] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.639047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.639216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.639350] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2de4eec-43fc-4180-be46-e291d4587236 already deleted. [ 827.639492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.794556] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.794556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.794748] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.794873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.795061] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.795195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.795358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.795457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.795542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.795630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.795794] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.795887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.795960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.796140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.796313] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.796408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.796447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.796616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.796707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.796792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.796892] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.006019] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.006232] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.006232] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.006495] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.006643] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.006803] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 8b56c930-252e-4467-8a7f-58e82cf04fc8 not found, creating... [ 828.007086] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.007249] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.007381] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.007608] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.007745] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.008042] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.008194] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.008312] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.008524] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.008644] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.008781] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 8b56c930-252e-4467-8a7f-58e82cf04fc8 is going to be created. [ 828.048267] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.048534] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.048770] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.049351] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.049823] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.050724] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-8b56c930-252e-4467-8a7f-58e82cf04fc8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.299092] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c: rpc.has_security_group_logging(os_id): False [ 828.320755] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.321077] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.321177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.321433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.321524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.321771] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.321892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.321954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.322151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.322245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.322452] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.322549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.322618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.322759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.322852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.324428] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.324560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.324601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.324784] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.324828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.324922] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be created. [ 828.384991] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.385284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.385284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.385520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.385685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.402808] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 828.753378] env[65678]: INFO networking_nsxv3.common.synchronization [req-280d2498-d192-4c46-be30-43286db6fdc4 req-3fc26bc3-ad1d-4500-bd6e-749920c860bc service nova] Enqueued Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_rules [ 828.753774] env[65678]: INFO networking_nsxv3.common.synchronization [req-280d2498-d192-4c46-be30-43286db6fdc4 req-3fc26bc3-ad1d-4500-bd6e-749920c860bc service nova] Enqueued Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_members [ 828.754175] env[65678]: INFO networking_nsxv3.common.synchronization [req-280d2498-d192-4c46-be30-43286db6fdc4 req-3fc26bc3-ad1d-4500-bd6e-749920c860bc service nova] Enqueued Resource ID: 8b56c930-252e-4467-8a7f-58e82cf04fc8 with Priority: HIGHEST for action port [ 828.754911] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_rules [ 828.755706] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_members [ 828.755706] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b56c930-252e-4467-8a7f-58e82cf04fc8 with Priority: HIGHEST for action port [ 828.755706] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2de4eec-43fc-4180-be46-e291d4587236 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.755706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.755964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.756132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.756239] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.757181] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2de4eec-43fc-4180-be46-e291d4587236 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.757307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.757378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.757553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.757691] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.758031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.758031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.758136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.758136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.758232] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.759307] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b56c930-252e-4467-8a7f-58e82cf04fc8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.759377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b56c930-252e-4467-8a7f-58e82cf04fc8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.760690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b56c930-252e-4467-8a7f-58e82cf04fc8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.760690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b56c930-252e-4467-8a7f-58e82cf04fc8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.760690] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b56c930-252e-4467-8a7f-58e82cf04fc8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.262327] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2de4eec-43fc-4180-be46-e291d4587236 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.262453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.262631] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.263885] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b56c930-252e-4467-8a7f-58e82cf04fc8 with status ACTIVE [ 829.264078] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.264190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.264256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.264457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.264559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.264701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.264796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.264867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.264986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.266691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.266691] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.266691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.266691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.266872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.266872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.266994] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b56c930-252e-4467-8a7f-58e82cf04fc8 is going to be updated. [ 829.288881] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.289021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.289283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.289283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.289419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.289573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b56c930-252e-4467-8a7f-58e82cf04fc8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.770334] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.277378] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.277378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.277378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.277568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.277643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.277740] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2de4eec-43fc-4180-be46-e291d4587236 is going to be created. [ 830.304552] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.304780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.304780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.304990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.305171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.316190] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2de4eec-43fc-4180-be46-e291d4587236 in Status: UNINITIALIZED for 2s [ 830.417657] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 830.417882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.118145] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca8847e0-e976-4435-93bc-ddbbb863c094 req-ba80d39e-1794-4a23-b439-60381e17d52f tempest-ServerRescueNegativeTestJSON-113281034 tempest-ServerRescueNegativeTestJSON-113281034-project-member] Enqueued Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_members [ 832.119093] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_members [ 832.119093] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-365d72a1-5a30-4ddf-b653-b2fb3c894c63 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.119286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.119286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.120647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.120801] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.120801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.120984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.121202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.121301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.121388] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.329200] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2de4eec-43fc-4180-be46-e291d4587236 in Status: SUCCESS [ 832.329200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.329200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.329200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.329200] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.329450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.329450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.329605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.329690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.329777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.329883] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.459135] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.459135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.459135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.459135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.459381] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.459535] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.459697] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.459987] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.461027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.461027] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.461145] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.461220] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.461326] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.461437] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.461540] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.461682] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.480182] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.480356] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.480493] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.480665] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-557" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.480980] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-9c60c992-cd95-4e2c-9c24-37841e823c2c taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.481168] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-9c60c992-cd95-4e2c-9c24-37841e823c2c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.481269] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-9c60c992-cd95-4e2c-9c24-37841e823c2c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.481582] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-9c60c992-cd95-4e2c-9c24-37841e823c2c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.481717] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c60c992-cd95-4e2c-9c24-37841e823c2c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.624721] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.624878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.624965] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.625195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.625288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.625479] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.625579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.625639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.625783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.625859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.625942] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 already deleted. [ 832.626033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.832768] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.984265] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.984645] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.984826] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.985120] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.985444] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.985516] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 9c60c992-cd95-4e2c-9c24-37841e823c2c not found, creating... [ 832.985803] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.986046] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.986393] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.986438] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.986571] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.986884] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.987056] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.987197] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.987426] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.987595] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.987747] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 9c60c992-cd95-4e2c-9c24-37841e823c2c is going to be created. [ 833.010669] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.010669] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.010669] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.010824] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.011193] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.012323] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-9c60c992-cd95-4e2c-9c24-37841e823c2c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.337162] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2de4eec-43fc-4180-be46-e291d4587236: rpc.has_security_group_logging(os_id): False [ 833.356226] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.356399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.356444] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.356635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.356727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.356968] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.357079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.357145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.357299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.357375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.357463] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2de4eec-43fc-4180-be46-e291d4587236 is going to be created. [ 833.422235] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.422444] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.422514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.422736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.424024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.437164] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2de4eec-43fc-4180-be46-e291d4587236 in Status: IN_PROGRESS for 2s [ 833.727301] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca8847e0-e976-4435-93bc-ddbbb863c094 req-3612b880-1e3f-42ba-8ffc-9ea14123c77c service nova] Enqueued Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_rules [ 833.727510] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca8847e0-e976-4435-93bc-ddbbb863c094 req-3612b880-1e3f-42ba-8ffc-9ea14123c77c service nova] Enqueued Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_members [ 833.727666] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca8847e0-e976-4435-93bc-ddbbb863c094 req-3612b880-1e3f-42ba-8ffc-9ea14123c77c service nova] Enqueued Resource ID: 9c60c992-cd95-4e2c-9c24-37841e823c2c with Priority: HIGHEST for action port [ 833.728212] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_rules [ 833.728373] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_members [ 833.728500] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c60c992-cd95-4e2c-9c24-37841e823c2c with Priority: HIGHEST for action port [ 833.728815] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.729954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.730062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.730373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.730491] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.733186] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-365d72a1-5a30-4ddf-b653-b2fb3c894c63 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.733186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.733186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.733186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.733377] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.733422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.733455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.733864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.733864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.733864] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.738897] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c60c992-cd95-4e2c-9c24-37841e823c2c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.738897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c60c992-cd95-4e2c-9c24-37841e823c2c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.738897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c60c992-cd95-4e2c-9c24-37841e823c2c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.738897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c60c992-cd95-4e2c-9c24-37841e823c2c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.738897] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c60c992-cd95-4e2c-9c24-37841e823c2c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.240721] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-365d72a1-5a30-4ddf-b653-b2fb3c894c63 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.240721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.240721] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.242137] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c60c992-cd95-4e2c-9c24-37841e823c2c with status ACTIVE [ 834.242137] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.242137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.242137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.242137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.242137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.242439] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.242439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.242439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.242572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.242620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.243133] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.243133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.243133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.243133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.243354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.243354] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c60c992-cd95-4e2c-9c24-37841e823c2c is going to be updated. [ 834.265337] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.265503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.265544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.265980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.266113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.266251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c60c992-cd95-4e2c-9c24-37841e823c2c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.745401] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.248607] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.248775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.248833] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.249032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.249109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.249226] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 is going to be created. [ 835.274462] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.274623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.274693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.275106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.275211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.285735] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 in Status: UNINITIALIZED for 2s [ 835.450104] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2de4eec-43fc-4180-be46-e291d4587236 in Status: SUCCESS [ 835.450341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.298793] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 in Status: SUCCESS [ 837.299209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.299399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.299622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.299837] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.299931] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.300067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.300247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.300334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.300619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.300735] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.802475] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.085206] env[65678]: INFO networking_nsxv3.common.synchronization [req-c8146587-5e54-41d8-bd3c-47ba41102a08 req-4ee57a72-a8d4-4575-983f-702c922d2a29 tempest-ServerGroupTestJSON-674906910 tempest-ServerGroupTestJSON-674906910-project-member] Enqueued Resource ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 with Priority: HIGHEST for action security_group_members [ 838.086025] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 with Priority: HIGHEST for action security_group_members [ 838.086531] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-802af02b-8ef5-41bb-a1fa-3f15ffa69531 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.086702] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.086836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.087203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.087384] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.087645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.087645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.087885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.087985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.088143] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('802af02b-8ef5-41bb-a1fa-3f15ffa69531',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.305536] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 365d72a1-5a30-4ddf-b653-b2fb3c894c63: rpc.has_security_group_logging(os_id): False [ 838.324105] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.324243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.324312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.324530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.324623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.324858] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.324957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.325033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.325182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.325258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.325345] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 is going to be created. [ 838.389714] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.389853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.389905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.390136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.390318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.401764] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 in Status: IN_PROGRESS for 2s [ 838.466095] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-964 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.466378] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-964" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.466612] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-964" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.466972] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-964" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.467524] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.467715] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.467875] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.468168] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.468393] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.468692] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.468839] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.468975] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.469131] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.469281] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.469451] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.469700] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.491334] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.491553] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 838.491664] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.491818] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-964" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.492157] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-78f9e311-7ae1-498e-a9ea-4e086f404336 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.492356] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-78f9e311-7ae1-498e-a9ea-4e086f404336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.492472] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-78f9e311-7ae1-498e-a9ea-4e086f404336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.492800] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-78f9e311-7ae1-498e-a9ea-4e086f404336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.493019] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78f9e311-7ae1-498e-a9ea-4e086f404336',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.593093] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.593093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.593093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.593093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.593093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.593093] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.593093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.593606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.593606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.593771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.593771] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 already deleted. [ 838.593943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.995773] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.995994] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.996134] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.996427] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.996577] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.996728] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 78f9e311-7ae1-498e-a9ea-4e086f404336 not found, creating... [ 838.996981] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.997153] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.997267] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.997506] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.997640] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.997913] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.998079] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.998196] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.998423] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.998557] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.998693] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 78f9e311-7ae1-498e-a9ea-4e086f404336 is going to be created. [ 839.021194] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.021456] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.021581] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.021857] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.022113] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.022320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-78f9e311-7ae1-498e-a9ea-4e086f404336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.635825] env[65678]: INFO networking_nsxv3.common.synchronization [req-65089885-88c8-409c-b281-98b5bb5fddc6 req-3f1caaf5-70ed-43da-817e-106cc21e3db9 tempest-ImagesOneServerNegativeTestJSON-281812694 tempest-ImagesOneServerNegativeTestJSON-281812694-project-member] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 839.636391] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 839.636693] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.636963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.636963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.637373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.637538] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.637641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.637705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.638012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.638012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.638117] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.737744] env[65678]: INFO networking_nsxv3.common.synchronization [req-c8146587-5e54-41d8-bd3c-47ba41102a08 req-d86d90a1-5729-44bd-814f-69e6fa7fbcdd service nova] Enqueued Resource ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 with Priority: HIGHEST for action security_group_rules [ 839.737744] env[65678]: INFO networking_nsxv3.common.synchronization [req-c8146587-5e54-41d8-bd3c-47ba41102a08 req-d86d90a1-5729-44bd-814f-69e6fa7fbcdd service nova] Enqueued Resource ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 with Priority: HIGHEST for action security_group_members [ 839.737744] env[65678]: INFO networking_nsxv3.common.synchronization [req-c8146587-5e54-41d8-bd3c-47ba41102a08 req-d86d90a1-5729-44bd-814f-69e6fa7fbcdd service nova] Enqueued Resource ID: 78f9e311-7ae1-498e-a9ea-4e086f404336 with Priority: HIGHEST for action port [ 839.737971] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 with Priority: HIGHEST for action security_group_rules [ 839.738120] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 with Priority: HIGHEST for action security_group_members [ 839.738214] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f9e311-7ae1-498e-a9ea-4e086f404336 with Priority: HIGHEST for action port [ 839.739199] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-802af02b-8ef5-41bb-a1fa-3f15ffa69531 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.739348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.739348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.739563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.739653] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('802af02b-8ef5-41bb-a1fa-3f15ffa69531',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.740591] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-802af02b-8ef5-41bb-a1fa-3f15ffa69531 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.740774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.740774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.740975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.742212] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.742313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.743089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.743089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.743089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.743089] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('802af02b-8ef5-41bb-a1fa-3f15ffa69531',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.744403] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-78f9e311-7ae1-498e-a9ea-4e086f404336 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.744403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78f9e311-7ae1-498e-a9ea-4e086f404336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.744403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78f9e311-7ae1-498e-a9ea-4e086f404336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.744403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78f9e311-7ae1-498e-a9ea-4e086f404336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.744403] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78f9e311-7ae1-498e-a9ea-4e086f404336',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.075659] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-408 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.075847] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.076080] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.076270] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.076525] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.076695] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.076873] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.077114] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.077567] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.077567] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.077567] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.077716] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.077749] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.077860] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.077961] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.078102] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.107867] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.108138] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.108259] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.109140] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.109140] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.109140] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.109318] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.110027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.110027] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.140166] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.140315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.140400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.140607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.163264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.163542] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.163636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.163723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.163888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.164012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.164179] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be updated. [ 840.191944] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.192129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.192204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.193148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.193148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.203959] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 840.246023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-802af02b-8ef5-41bb-a1fa-3f15ffa69531 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.246561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.246561] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('802af02b-8ef5-41bb-a1fa-3f15ffa69531',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.247292] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78f9e311-7ae1-498e-a9ea-4e086f404336 with status ACTIVE [ 840.247484] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.247618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.247711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.247867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.247958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.248150] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.248289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.248289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.248626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.248626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.249144] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.249144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.249144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.249144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.249144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.249144] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78f9e311-7ae1-498e-a9ea-4e086f404336 is going to be updated. [ 840.285192] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.285380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.285452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.285660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.285795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.285958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78f9e311-7ae1-498e-a9ea-4e086f404336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.415861] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 in Status: SUCCESS [ 840.416134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.615518] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.615811] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.615972] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.616324] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.616483] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.616640] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9 not found, creating... [ 840.617059] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.617059] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.617168] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.617367] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.617497] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.617769] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.617918] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.618049] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.618256] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.618433] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.618588] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9 is going to be created. [ 840.638281] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.638611] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.638653] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.638883] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.639123] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.639347] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.752101] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('802af02b-8ef5-41bb-a1fa-3f15ffa69531',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.254276] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.254471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.254471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.254619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.254918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.254918] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 is going to be created. [ 841.283180] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.283364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.283454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.283674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.283836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.297774] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 in Status: UNINITIALIZED for 2s [ 841.342280] env[65678]: INFO networking_nsxv3.common.synchronization [req-65089885-88c8-409c-b281-98b5bb5fddc6 req-ee2dcd08-30d2-4270-a40f-3cb017308cbb service nova] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_rules [ 841.346023] env[65678]: INFO networking_nsxv3.common.synchronization [req-65089885-88c8-409c-b281-98b5bb5fddc6 req-ee2dcd08-30d2-4270-a40f-3cb017308cbb service nova] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 841.346023] env[65678]: INFO networking_nsxv3.common.synchronization [req-65089885-88c8-409c-b281-98b5bb5fddc6 req-ee2dcd08-30d2-4270-a40f-3cb017308cbb service nova] Enqueued Resource ID: 5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9 with Priority: HIGHEST for action port [ 841.346023] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_rules [ 841.346023] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 841.346023] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9 with Priority: HIGHEST for action port [ 841.346023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.346023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.346023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.346023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.346023] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.346023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.346023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.346023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.346023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.346023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.346023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.346881] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.849107] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.849542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.849542] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9 with status ACTIVE [ 841.851566] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.851566] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.851566] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.851566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.852460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.852460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.852460] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9 is going to be updated. [ 841.878635] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.878815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.878924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.879125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.879270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.879447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fbb7b0d-85a1-474e-a2d1-b4604fedf5d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.216727] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 842.216911] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 deletion is rescheduled due to dependency. [ 842.217172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.217274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.217576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.219598] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.219743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.219787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.219980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.220083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.220185] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.724452] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.227173] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.317873] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 in Status: SUCCESS [ 843.321532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.321532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.321532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.321532] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.321532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.321532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.324240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.324379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.324466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.324529] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('802af02b-8ef5-41bb-a1fa-3f15ffa69531',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.729759] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.731012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.731115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.731329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.731415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.731518] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be updated. [ 843.783823] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.783823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.783823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.783990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.784176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.798424] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 843.828329] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-802af02b-8ef5-41bb-a1fa-3f15ffa69531 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.828529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.828529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.828860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.829074] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.829178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.829268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.829441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.829555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.829667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.829944] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-802af02b-8ef5-41bb-a1fa-3f15ffa69531 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.830080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.830145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.830350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.830489] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.830627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.830722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.830953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.831063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.831178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.831310] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('802af02b-8ef5-41bb-a1fa-3f15ffa69531',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.333640] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 802af02b-8ef5-41bb-a1fa-3f15ffa69531: rpc.has_security_group_logging(os_id): False [ 844.354364] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.354364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.354364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.354622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.354622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.354754] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.354829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.354898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.355071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.355198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.355352] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.355523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.355575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.355723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.355796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.355989] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.356095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.356156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.356295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.356375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.356820] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 is going to be created. [ 844.422894] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.423068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.423158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.423316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.423493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.436166] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 in Status: IN_PROGRESS for 2s [ 844.712752] env[65678]: INFO networking_nsxv3.common.synchronization [req-f579f970-35da-4185-902c-f8fc4971fa60 req-931b7e1c-1fee-41ae-bd90-859805cb4739 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_members [ 844.713885] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_members [ 844.713885] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcfce19-b3dc-46b9-a272-88acde866ff3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.714143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.714143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.714323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.714489] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.714591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.714642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.714806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.714914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.715020] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.192233] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.192550] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.192721] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.193159] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.193534] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.193749] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.193958] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.194325] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.194560] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.194968] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.195059] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.195174] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.195349] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.195493] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.195640] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.195869] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.217949] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.218236] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 845.218389] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.218584] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.219137] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-7a3a3b3a-7457-4698-ac12-11348b074a86 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.219334] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-7a3a3b3a-7457-4698-ac12-11348b074a86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.219454] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-7a3a3b3a-7457-4698-ac12-11348b074a86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.219831] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-7a3a3b3a-7457-4698-ac12-11348b074a86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.219976] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a3a3b3a-7457-4698-ac12-11348b074a86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.221216] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.221379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.221547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.221763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.221855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.222071] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.222282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.222282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.222453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.222563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.222700] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 already deleted. [ 845.222806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.727027] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.727027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.727027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.727027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.727027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.727027] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 7a3a3b3a-7457-4698-ac12-11348b074a86 not found, creating... [ 845.727027] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.727027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.727027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.727027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.727027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.728093] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.728093] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.729017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.730187] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.730504] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.730799] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 7a3a3b3a-7457-4698-ac12-11348b074a86 is going to be created. [ 845.758608] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.758608] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.760027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.760027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.760027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.760027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-7a3a3b3a-7457-4698-ac12-11348b074a86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.810847] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 845.811835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.813070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.813070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.813070] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.813842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.813842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.813842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.813842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.814032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.814646] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.318500] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.319119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.319344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.319673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.320054] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.320294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.320438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.320784] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.321273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.321814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.323563] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.323563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.323563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.323563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.323843] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.323843] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.324046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.324168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.324220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.324348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.324456] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.449655] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 in Status: SUCCESS [ 846.449993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.506741] env[65678]: INFO networking_nsxv3.common.synchronization [req-f579f970-35da-4185-902c-f8fc4971fa60 req-c1dfa60b-af3c-4b57-b188-88909bedb43f service nova] Enqueued Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_rules [ 846.508031] env[65678]: INFO networking_nsxv3.common.synchronization [req-f579f970-35da-4185-902c-f8fc4971fa60 req-c1dfa60b-af3c-4b57-b188-88909bedb43f service nova] Enqueued Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_members [ 846.508031] env[65678]: INFO networking_nsxv3.common.synchronization [req-f579f970-35da-4185-902c-f8fc4971fa60 req-c1dfa60b-af3c-4b57-b188-88909bedb43f service nova] Enqueued Resource ID: 7a3a3b3a-7457-4698-ac12-11348b074a86 with Priority: HIGHEST for action port [ 846.508504] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_rules [ 846.508695] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_members [ 846.508826] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a3a3b3a-7457-4698-ac12-11348b074a86 with Priority: HIGHEST for action port [ 846.509218] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bcfce19-b3dc-46b9-a272-88acde866ff3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.509405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.509446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.510797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.511185] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.513468] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcfce19-b3dc-46b9-a272-88acde866ff3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.513684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.514062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.514062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.514248] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.514393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.514503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.514940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.514940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.515096] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.516245] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a3a3b3a-7457-4698-ac12-11348b074a86 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.516357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a3a3b3a-7457-4698-ac12-11348b074a86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.516494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a3a3b3a-7457-4698-ac12-11348b074a86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.516707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a3a3b3a-7457-4698-ac12-11348b074a86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.516838] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a3a3b3a-7457-4698-ac12-11348b074a86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.828603] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b634fd1e-f1ec-4189-ac44-9f8fa9578204: rpc.has_security_group_logging(os_id): False [ 846.850359] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.850359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.850359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.850359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.850359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.850359] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.850359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.850359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.850952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.850952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.850952] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.850952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.851224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.851224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.851336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.851447] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.851562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.851644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.852042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.852042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.852042] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be updated. [ 846.929834] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.930108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.930108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.930279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.930423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.944945] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 847.019204] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcfce19-b3dc-46b9-a272-88acde866ff3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.019355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.019544] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.022025] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a3a3b3a-7457-4698-ac12-11348b074a86 with status ACTIVE [ 847.022117] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.022186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.022233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.022494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.022560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.022745] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.022841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.022902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.023333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.023411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.023608] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.023700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.023779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.024074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.024074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.024170] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a3a3b3a-7457-4698-ac12-11348b074a86 is going to be updated. [ 847.065920] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.066388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.066491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.066712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.066857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.067045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a3a3b3a-7457-4698-ac12-11348b074a86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.522566] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.562324] env[65678]: INFO networking_nsxv3.common.synchronization [req-055481af-c142-472a-8d36-9b7033dbe357 req-96e72ffb-90c1-41a6-a13b-f232b81e8d26 tempest-ServersWithSpecificFlavorTestJSON-1798572525 tempest-ServersWithSpecificFlavorTestJSON-1798572525-project-member] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 847.563497] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 847.563802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.563990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.564091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.564303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.564536] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.564630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.564672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.564808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.564896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.564991] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.949359] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.949668] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.949707] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.950032] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.950295] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.950449] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.950561] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.950778] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.950915] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.951140] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.951250] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.951352] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.951454] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.951561] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.951660] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.951787] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.974948] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.975721] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 847.975721] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.975721] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-977" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.975907] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-6cd7910e-1e7e-4068-9e0a-241835a3aef1 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.976056] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-6cd7910e-1e7e-4068-9e0a-241835a3aef1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.976095] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-6cd7910e-1e7e-4068-9e0a-241835a3aef1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.976422] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-6cd7910e-1e7e-4068-9e0a-241835a3aef1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.976575] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cd7910e-1e7e-4068-9e0a-241835a3aef1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.024576] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.024835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.024919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.025188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.025349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.025483] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 is going to be created. [ 848.052701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.052701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.052874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.053035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.053504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.064267] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 in Status: UNINITIALIZED for 2s [ 848.067160] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.067319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.067379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.067591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.126343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.126756] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.126958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.127071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.127367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.127489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.127625] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d6ddb-7487-401b-862b-e16865015657 is going to be updated. [ 848.158866] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.158995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.159094] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.159329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.159488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.170547] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: IN_PROGRESS for 2s [ 848.478742] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.479084] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.479502] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.479697] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.479877] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.480168] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 6cd7910e-1e7e-4068-9e0a-241835a3aef1 not found, creating... [ 848.480560] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.480789] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.481089] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.481370] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.481552] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.482104] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.482325] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.482479] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.482856] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.483127] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.483361] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 6cd7910e-1e7e-4068-9e0a-241835a3aef1 is going to be created. [ 848.509157] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.509507] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.509690] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.509986] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.510284] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.510637] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-6cd7910e-1e7e-4068-9e0a-241835a3aef1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.964194] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 848.964608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.252770] env[65678]: INFO networking_nsxv3.common.synchronization [req-055481af-c142-472a-8d36-9b7033dbe357 req-23378e40-0457-4fd4-9b13-372478994f52 service nova] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_rules [ 849.252770] env[65678]: INFO networking_nsxv3.common.synchronization [req-055481af-c142-472a-8d36-9b7033dbe357 req-23378e40-0457-4fd4-9b13-372478994f52 service nova] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 849.252909] env[65678]: INFO networking_nsxv3.common.synchronization [req-055481af-c142-472a-8d36-9b7033dbe357 req-23378e40-0457-4fd4-9b13-372478994f52 service nova] Enqueued Resource ID: 6cd7910e-1e7e-4068-9e0a-241835a3aef1 with Priority: HIGHEST for action port [ 849.253660] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_rules [ 849.253801] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 849.253898] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cd7910e-1e7e-4068-9e0a-241835a3aef1 with Priority: HIGHEST for action port [ 849.254189] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.254325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.254387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.254592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.254726] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.255773] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.255936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.255980] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cd7910e-1e7e-4068-9e0a-241835a3aef1 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.256153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cd7910e-1e7e-4068-9e0a-241835a3aef1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.256153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cd7910e-1e7e-4068-9e0a-241835a3aef1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.256393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cd7910e-1e7e-4068-9e0a-241835a3aef1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.256393] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cd7910e-1e7e-4068-9e0a-241835a3aef1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.759703] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.759703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.760157] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6cd7910e-1e7e-4068-9e0a-241835a3aef1 with status ACTIVE [ 849.760157] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.760157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.760157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.760471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.760724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.760724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.761011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.761011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.761099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.761178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.761368] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.761462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.761523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.761674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.761747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.761831] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6cd7910e-1e7e-4068-9e0a-241835a3aef1 is going to be updated. [ 849.794527] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.794527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.794527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.794527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.794527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.794527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cd7910e-1e7e-4068-9e0a-241835a3aef1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.075939] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 in Status: SUCCESS [ 850.075939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.075939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.076485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.076485] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.076485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.076685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.076685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.076789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.076842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.077449] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.191948] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: SUCCESS [ 850.191948] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d6ddb-7487-401b-862b-e16865015657 deletion is rescheduled due to dependency. [ 850.191948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.192570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.192570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.192570] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.192570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.192731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.192765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.192885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.192942] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.579109] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.695553] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.081738] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bcfce19-b3dc-46b9-a272-88acde866ff3: rpc.has_security_group_logging(os_id): False [ 851.119357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.119511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.119614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.119799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.119905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.120184] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.120315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.120374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.120506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.120595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.120666] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 is going to be created. [ 851.200621] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.200824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.200824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.201105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.201282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.202576] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.222220] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 in Status: IN_PROGRESS for 2s [ 851.706096] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.706286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.706362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.706582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.706672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.706770] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d6ddb-7487-401b-862b-e16865015657 is going to be updated. [ 851.738055] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.738055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.738055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.738309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.738309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.747268] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: IN_PROGRESS for 2s [ 853.235795] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 in Status: SUCCESS [ 853.236129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.516144] env[65678]: INFO networking_nsxv3.common.synchronization [req-3167ba37-3dc5-467f-a558-b8e18ef68560 req-4c3d9880-f2de-4e4b-957a-9660cc306714 tempest-ServerGroupTestJSON-674906910 tempest-ServerGroupTestJSON-674906910-project-member] Enqueued Resource ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 with Priority: HIGHEST for action security_group_members [ 853.516711] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 with Priority: HIGHEST for action security_group_members [ 853.517016] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-802af02b-8ef5-41bb-a1fa-3f15ffa69531 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.517234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.517305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.517532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.517728] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.517871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.517940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.518283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.518396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.518501] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('802af02b-8ef5-41bb-a1fa-3f15ffa69531',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.761287] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: SUCCESS [ 853.761287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.761287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.761287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.761287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.761287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.761287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.761287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.761287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.761287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.761287] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.021457] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.021587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.021653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.024229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.024229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.024229] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.024229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.024229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.024229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.024229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.024229] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 is going to be updated. [ 854.053849] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.054030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.054102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.054312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.054450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.064673] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 in Status: IN_PROGRESS for 2s [ 854.263178] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.536783] env[65678]: INFO networking_nsxv3.common.synchronization [req-7fc98294-e3a1-4672-ad48-a09ae5cf054a req-3fc4cdf5-e569-434d-b92a-2bb95e9df048 tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 854.537355] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 854.537661] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.537781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.537847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.538507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.538712] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.538818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.539516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.539762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.539882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.540013] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.769776] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 433d6ddb-7487-401b-862b-e16865015657: rpc.has_security_group_logging(os_id): False [ 854.786723] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.786976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.786976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.787326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.787437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.787731] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.787863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.787928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.788154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.788236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.788322] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433d6ddb-7487-401b-862b-e16865015657 is going to be updated. [ 854.868398] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.869036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.869141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.869597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.869823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.884718] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: IN_PROGRESS for 2s [ 855.044968] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.045334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.045334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.046034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.046034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.046034] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.046034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.046034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.046284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.046284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.046418] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 855.077092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.077340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.077340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.077507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.077661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.088404] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 855.241278] env[65678]: INFO networking_nsxv3.common.synchronization [req-ea0d46dd-d7c2-4ea2-a385-6df845a6ece6 req-0077449e-8125-42e9-baa1-d252826659a6 tempest-ServersTestBootFromVolume-2101032171 tempest-ServersTestBootFromVolume-2101032171-project-member] Enqueued Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_members [ 855.243183] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_members [ 855.243183] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d87d2c-0ecc-4c94-9119-6c94790a0c86 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.243183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.243183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.243183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.243183] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.243446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.243446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.243523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.244359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.244359] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.739257] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.740064] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-744" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.740442] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-744" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.741036] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-744" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.741547] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.741964] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.742322] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.742746] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.743155] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.743593] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.743836] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.744112] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.744338] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.744558] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.744764] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.745026] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.747053] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.747053] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.747053] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.747053] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.747347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.747653] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.748374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.748374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.748374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.748374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.748374] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 already deleted. [ 855.748374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.767036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.767036] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.767242] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.767242] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-744" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.767542] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-dd372a99-6d2e-4177-94d8-bd52c93bca45 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.767711] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-dd372a99-6d2e-4177-94d8-bd52c93bca45" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.767824] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-dd372a99-6d2e-4177-94d8-bd52c93bca45" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.768198] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-dd372a99-6d2e-4177-94d8-bd52c93bca45" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.768377] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd372a99-6d2e-4177-94d8-bd52c93bca45',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.076977] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 in Status: SUCCESS [ 856.076977] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 deletion is rescheduled due to dependency. [ 856.076977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-802af02b-8ef5-41bb-a1fa-3f15ffa69531" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.271238] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.271238] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.271238] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.271238] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.271548] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.271548] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port dd372a99-6d2e-4177-94d8-bd52c93bca45 not found, creating... [ 856.271843] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.271934] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.272036] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.272264] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.272396] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.272670] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.272823] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.272937] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.273944] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.274158] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.274321] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: dd372a99-6d2e-4177-94d8-bd52c93bca45 is going to be created. [ 856.301633] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.301633] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.301633] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.301983] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.302284] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.302548] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-dd372a99-6d2e-4177-94d8-bd52c93bca45" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.899569] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: SUCCESS [ 856.899972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.030774] env[65678]: INFO networking_nsxv3.common.synchronization [req-ea0d46dd-d7c2-4ea2-a385-6df845a6ece6 req-b8ec5a03-deb9-4e32-9864-bb0667542183 service nova] Enqueued Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_rules [ 857.030774] env[65678]: INFO networking_nsxv3.common.synchronization [req-ea0d46dd-d7c2-4ea2-a385-6df845a6ece6 req-b8ec5a03-deb9-4e32-9864-bb0667542183 service nova] Enqueued Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_members [ 857.030774] env[65678]: INFO networking_nsxv3.common.synchronization [req-ea0d46dd-d7c2-4ea2-a385-6df845a6ece6 req-b8ec5a03-deb9-4e32-9864-bb0667542183 service nova] Enqueued Resource ID: dd372a99-6d2e-4177-94d8-bd52c93bca45 with Priority: HIGHEST for action port [ 857.031853] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_rules [ 857.031853] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_members [ 857.032096] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd372a99-6d2e-4177-94d8-bd52c93bca45 with Priority: HIGHEST for action port [ 857.032330] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.032461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.032537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.032769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.032890] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.033797] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d87d2c-0ecc-4c94-9119-6c94790a0c86 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.033880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.034475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.034475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.034475] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.034475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.034475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.034726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.034726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.034726] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.036388] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd372a99-6d2e-4177-94d8-bd52c93bca45 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.036388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd372a99-6d2e-4177-94d8-bd52c93bca45" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.036511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd372a99-6d2e-4177-94d8-bd52c93bca45" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.037688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd372a99-6d2e-4177-94d8-bd52c93bca45" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.037688] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd372a99-6d2e-4177-94d8-bd52c93bca45',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.099541] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 857.099738] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c deletion is rescheduled due to dependency. [ 857.099825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.538713] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d87d2c-0ecc-4c94-9119-6c94790a0c86 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.538909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.539106] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd372a99-6d2e-4177-94d8-bd52c93bca45 with status ACTIVE [ 857.539307] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.539475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.539576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.539814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.539913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.540140] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.540283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.540326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.540482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.540591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.540796] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.540890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.540983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.541136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.541210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.541295] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd372a99-6d2e-4177-94d8-bd52c93bca45 is going to be updated. [ 857.542408] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.566943] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.567064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.567064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.567284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.567426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.567594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd372a99-6d2e-4177-94d8-bd52c93bca45" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.044452] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.548070] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.548070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.548070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.548070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.548070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.548386] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 is going to be created. [ 858.571296] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.571471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.571515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.571721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.571883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.585364] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 in Status: UNINITIALIZED for 2s [ 860.599342] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 in Status: SUCCESS [ 860.599705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.599752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.599987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.600380] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.600540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.600614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.600782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.600933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.601064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.601193] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.106207] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.195895] env[65678]: INFO networking_nsxv3.common.synchronization [req-0f00f188-6e77-4668-8003-23678afa9dc3 req-76526939-5561-4ee2-be1b-6f6abc8db19c tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 861.197014] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 861.198461] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.198613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.198685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.198903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.199092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.199881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.199881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.199881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.199881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.199881] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.225917] env[65678]: INFO networking_nsxv3.common.synchronization [req-0f00f188-6e77-4668-8003-23678afa9dc3 req-76526939-5561-4ee2-be1b-6f6abc8db19c tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 861.226133] env[65678]: INFO networking_nsxv3.common.synchronization [req-0f00f188-6e77-4668-8003-23678afa9dc3 req-76526939-5561-4ee2-be1b-6f6abc8db19c tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 861.226266] env[65678]: INFO networking_nsxv3.common.synchronization [req-0f00f188-6e77-4668-8003-23678afa9dc3 req-76526939-5561-4ee2-be1b-6f6abc8db19c tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: d347306e-123e-4b8f-953d-d2786a356d14 with Priority: HIGHEST for action port [ 861.226814] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 861.226948] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 861.229898] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d347306e-123e-4b8f-953d-d2786a356d14 with Priority: HIGHEST for action port [ 861.230334] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.230636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.231080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.231326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.231459] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.232777] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.233022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.233758] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d347306e-123e-4b8f-953d-d2786a356d14 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.233901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.233990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.234263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.234724] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d347306e-123e-4b8f-953d-d2786a356d14',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.608310] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25d87d2c-0ecc-4c94-9119-6c94790a0c86: rpc.has_security_group_logging(os_id): False [ 861.632324] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.632535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.632535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.632745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.632835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.633153] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.633285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.633364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.633539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.637022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.637022] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 is going to be created. [ 861.703272] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.703272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.703272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.703272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.703272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.704433] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.720238] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 in Status: IN_PROGRESS for 2s [ 861.737692] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.737873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.738052] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d347306e-123e-4b8f-953d-d2786a356d14 with status ACTIVE [ 861.738221] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.738327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.738389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.738602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.738689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.738856] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.738956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.739050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.739220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.739334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.739488] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.739638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.739887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.739887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.739994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.740051] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d347306e-123e-4b8f-953d-d2786a356d14 is going to be updated. [ 861.770480] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.771723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.771723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.771723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.771723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.771723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.206938] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.711265] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.711265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.711265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.711265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.711265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.711265] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 is going to be updated. [ 862.743070] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.743252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.743252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.743789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.743789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.753945] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: IN_PROGRESS for 2s [ 863.481450] env[65678]: INFO networking_nsxv3.common.synchronization [req-6a88a476-0701-49bd-b9c3-815ce88911da req-b764a233-02ac-4093-945f-77a017643ea7 tempest-ImagesOneServerNegativeTestJSON-281812694 tempest-ImagesOneServerNegativeTestJSON-281812694-project-member] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 863.482361] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 863.482526] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.482721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.482809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.483120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.483385] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.483500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.483579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.483811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.483811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.483921] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.733908] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 in Status: SUCCESS [ 863.734286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.986593] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.986738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.986738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.987041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.987176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.987473] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.987535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.987570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.987791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.987860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.987976] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be updated. [ 864.022022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.022022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.022022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.022022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.022022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.033060] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 864.341046] env[65678]: INFO networking_nsxv3.common.synchronization [req-26687141-8589-4b63-9159-cf1868538a03 req-3941f0d9-1acf-4830-9532-4200c48e9a89 tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 864.341468] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 864.341829] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.341981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.354900] env[65678]: INFO networking_nsxv3.common.synchronization [req-26687141-8589-4b63-9159-cf1868538a03 req-3941f0d9-1acf-4830-9532-4200c48e9a89 tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 864.355116] env[65678]: INFO networking_nsxv3.common.synchronization [req-26687141-8589-4b63-9159-cf1868538a03 req-3941f0d9-1acf-4830-9532-4200c48e9a89 tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 864.355295] env[65678]: INFO networking_nsxv3.common.synchronization [req-26687141-8589-4b63-9159-cf1868538a03 req-3941f0d9-1acf-4830-9532-4200c48e9a89 tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: d347306e-123e-4b8f-953d-d2786a356d14 with Priority: HIGHEST for action port [ 864.355791] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_rules [ 864.355937] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 864.356248] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d347306e-123e-4b8f-953d-d2786a356d14 with Priority: HIGHEST for action port [ 864.356579] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.356705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.356935] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.357046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.357262] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d347306e-123e-4b8f-953d-d2786a356d14 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.357385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.357463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.357689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.357787] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d347306e-123e-4b8f-953d-d2786a356d14',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.765005] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: SUCCESS [ 864.765278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.765796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.766035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.766272] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.766356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.766412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.766569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.766651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.766747] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.861400] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d347306e-123e-4b8f-953d-d2786a356d14 with status ACTIVE [ 864.861705] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.861876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.861968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.862225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.862322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.862504] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.862607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.862667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.862827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.862906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.863343] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.863523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.863636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.863880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.864055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.864207] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d347306e-123e-4b8f-953d-d2786a356d14 is going to be updated. [ 864.887769] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.887920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.888523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.888523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.888523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.888523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d347306e-123e-4b8f-953d-d2786a356d14" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.269474] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.772148] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.046232] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 866.046446] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 deletion is rescheduled due to dependency. [ 866.046564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.277482] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.277645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.277693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.277927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.278034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.278137] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 is going to be updated. [ 866.304916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.305082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.305148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.305358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.305498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.316690] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: IN_PROGRESS for 2s [ 868.332364] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: SUCCESS [ 868.332752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.333046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.333374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.333668] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.333854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.333965] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.334283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.334377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.334530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.334692] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.336096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.336181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.336448] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.336628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.336736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.336966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.340088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.340189] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.741738] env[65678]: INFO networking_nsxv3.common.synchronization [req-efbf1449-94a8-4f3b-b2af-50b7b8ee3474 req-bffd11d3-74e1-418a-a581-4c93b88366aa tempest-AttachInterfacesUnderV243Test-1856629931 tempest-AttachInterfacesUnderV243Test-1856629931-project-member] Enqueued Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 868.742384] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 with Priority: HIGHEST for action security_group_members [ 868.742966] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d6db365-2384-4e4f-98b7-13262fcd05f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.742966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.842675] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.845706] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.323332] env[65678]: INFO networking_nsxv3.common.synchronization [req-823d82f9-9a9c-448e-b7ea-562044478d90 req-a6732dc0-59bf-4ec9-9206-d38a6bd05256 tempest-ListServerFiltersTestJSON-129772598 tempest-ListServerFiltersTestJSON-129772598-project-member] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 869.323976] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGHEST for action security_group_members [ 869.324361] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.324522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.324618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.324857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.325059] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.325196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.325284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.325468] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.325586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.325709] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.347965] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d6db365-2384-4e4f-98b7-13262fcd05f8: rpc.has_security_group_logging(os_id): False [ 869.349975] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.368774] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.368774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.368774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.368774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.390759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.391196] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.391340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.391449] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.392114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.392114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.392114] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 is going to be updated. [ 869.455153] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.455447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.455447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.455716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.455716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.471678] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: IN_PROGRESS for 2s [ 869.714857] env[65678]: INFO networking_nsxv3.common.synchronization [req-a3501be1-0230-4f34-9ec4-64b57201c811 req-bbc0a2db-7ddd-4abe-aec0-e0d22ac2fea9 tempest-ServersAdminNegativeTestJSON-1032160483 tempest-ServersAdminNegativeTestJSON-1032160483-project-member] Enqueued Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 869.715145] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 869.715465] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.715611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.715646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.715849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.716146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.716610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.716610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.716610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.716610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.716784] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.828175] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.832226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.832226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.832226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.857170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.857170] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.857170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.857170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.857170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.857170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.857170] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be updated. [ 869.858688] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.858897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.858997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.859235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.859322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.859436] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 is going to be updated. [ 869.892260] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.892588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.892700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.893297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.893513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.896698] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.896945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.896945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.897273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.897381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.912684] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: IN_PROGRESS for 2s [ 869.914024] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: IN_PROGRESS for 2s [ 870.131415] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.133018] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.133018] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.133018] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.133018] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.133018] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.133018] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.133018] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.133416] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.133717] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.133931] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.134200] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.139506] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.139506] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.139506] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.139506] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.165298] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.165298] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.165298] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.165298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.165298] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.165298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.165298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.165298] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.165298] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e44ebac6-07fa-4ab2-ad48-2ffeab99f95a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.222665] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.668297] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.668675] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.668675] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.668930] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.669093] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.669253] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port e44ebac6-07fa-4ab2-ad48-2ffeab99f95a not found, creating... [ 870.669552] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.669704] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.669822] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.670067] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.670184] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.670457] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.670639] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.670726] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.671044] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.671118] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.671281] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: e44ebac6-07fa-4ab2-ad48-2ffeab99f95a is going to be created. [ 870.691993] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.692232] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.692356] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.692646] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.692850] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.693254] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.725359] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.136096] env[65678]: INFO networking_nsxv3.common.synchronization [None req-a8346a20-bf9e-45fe-9b32-7dcbc7fc5985 None None] Enqueued Resource ID: ebfaddb4-9215-4512-8d6a-0ba8eda2c53b with Priority: HIGHEST for action port [ 871.136096] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfaddb4-9215-4512-8d6a-0ba8eda2c53b with Priority: HIGHEST for action port [ 871.136284] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebfaddb4-9215-4512-8d6a-0ba8eda2c53b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.136284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebfaddb4-9215-4512-8d6a-0ba8eda2c53b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.136445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebfaddb4-9215-4512-8d6a-0ba8eda2c53b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.136625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebfaddb4-9215-4512-8d6a-0ba8eda2c53b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.136713] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebfaddb4-9215-4512-8d6a-0ba8eda2c53b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.228368] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.228537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.228607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.229638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.229638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.229638] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2164111b-0060-40e2-86c3-edfc4931cb24 is going to be updated. [ 871.286974] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.287303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.287303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.287446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.287599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.310066] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: IN_PROGRESS for 2s [ 871.432470] env[65678]: INFO networking_nsxv3.common.synchronization [req-a3501be1-0230-4f34-9ec4-64b57201c811 req-8f29ce04-b295-485d-b9be-5930040ce8f7 service nova] Enqueued Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_rules [ 871.433159] env[65678]: INFO networking_nsxv3.common.synchronization [req-a3501be1-0230-4f34-9ec4-64b57201c811 req-8f29ce04-b295-485d-b9be-5930040ce8f7 service nova] Enqueued Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 871.433159] env[65678]: INFO networking_nsxv3.common.synchronization [req-a3501be1-0230-4f34-9ec4-64b57201c811 req-8f29ce04-b295-485d-b9be-5930040ce8f7 service nova] Enqueued Resource ID: e44ebac6-07fa-4ab2-ad48-2ffeab99f95a with Priority: HIGHEST for action port [ 871.433292] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_rules [ 871.433384] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 871.434622] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e44ebac6-07fa-4ab2-ad48-2ffeab99f95a with Priority: HIGHEST for action port [ 871.434622] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.434622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.434622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.434622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.434622] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.435684] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.438202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.438747] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.438747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.438747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.440509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.441963] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e44ebac6-07fa-4ab2-ad48-2ffeab99f95a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.490249] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: SUCCESS [ 871.490249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.490249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.490249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.490249] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.639558] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebfaddb4-9215-4512-8d6a-0ba8eda2c53b [ 871.639845] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.640009] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.640099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.640450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.640622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.640746] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebfaddb4-9215-4512-8d6a-0ba8eda2c53b already deleted. [ 871.640843] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebfaddb4-9215-4512-8d6a-0ba8eda2c53b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.708279] env[65678]: INFO networking_nsxv3.common.synchronization [req-d2a4f0bd-b80e-4946-8663-703adf8963de req-fd2d4fe9-0efa-4679-8c61-261c6eecc11d tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 with Priority: HIGHEST for action security_group_members [ 871.708627] env[65678]: INFO networking_nsxv3.common.synchronization [req-d2a4f0bd-b80e-4946-8663-703adf8963de req-fd2d4fe9-0efa-4679-8c61-261c6eecc11d tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 871.708627] env[65678]: INFO networking_nsxv3.common.synchronization [req-d2a4f0bd-b80e-4946-8663-703adf8963de req-fd2d4fe9-0efa-4679-8c61-261c6eecc11d tempest-SecurityGroupsTestJSON-565160028 tempest-SecurityGroupsTestJSON-565160028-project-member] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 871.710312] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 with Priority: HIGHEST for action security_group_members [ 871.710312] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGHEST for action security_group_members [ 871.710312] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGHEST for action security_group_members [ 871.710312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-394e9a35-6053-4366-8c10-efbb3bbed0b9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.710312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.710312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.710312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.710312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.710312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.710312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.710827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.710827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.710827] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('394e9a35-6053-4366-8c10-efbb3bbed0b9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.713592] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.713743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.713743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.713857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.714254] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.715026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.715112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.715249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.715406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.715406] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.717263] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.717263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.717263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.717263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.717263] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.717263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.717263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.717263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.717263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.717263] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.924619] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 in Status: SUCCESS [ 871.924847] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 deletion is rescheduled due to dependency. [ 871.924916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.926353] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 in Status: SUCCESS [ 871.926353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.926353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.926353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.926578] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.926578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.926675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.926814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.926891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.926955] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.943824] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.945475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.945475] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e44ebac6-07fa-4ab2-ad48-2ffeab99f95a with status ACTIVE [ 871.945475] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.945475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.945475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.945475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.945475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.945475] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.945475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.945475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.945475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.945475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.946365] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.946365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.946365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.946365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.946365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.946365] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e44ebac6-07fa-4ab2-ad48-2ffeab99f95a is going to be updated. [ 871.966904] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.970973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.970973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.970973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.970973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.970973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e44ebac6-07fa-4ab2-ad48-2ffeab99f95a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.011775] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.011999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.011999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.012201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.012291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.012390] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 is going to be deleted. [ 872.079770] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.079921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.079987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.080215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.080311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.080433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.218955] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.219158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.219200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.219391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.219481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.219674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.219880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.219880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.220071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.220071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.220136] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 is going to be updated. [ 872.221393] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.221505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.221578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.221721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.222878] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.223047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.261353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.261729] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.263392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.263392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.263392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.263392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.263392] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 is going to be updated. [ 872.263984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.263984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.263984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.264308] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.264516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.264516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.264685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.264728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.264810] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be updated. [ 872.283039] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.283935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.283935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.283935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.283935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.299613] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: IN_PROGRESS for 2s [ 872.303434] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.303619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.304066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.304066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.304226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.316610] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 in Status: IN_PROGRESS for 2s [ 872.429120] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.429696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.429788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.430013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.430102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.430668] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.430779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.430868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.431114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.432058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.432058] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 is going to be deleted. [ 872.468039] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.468260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.468260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.468376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.468469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.468566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.468722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.468889] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.469168] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.469276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.469339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.469484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.469564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.469656] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d6db365-2384-4e4f-98b7-13262fcd05f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.940867] env[65678]: INFO networking_nsxv3.common.synchronization [req-fe6a5ed2-502c-4a7e-92c8-20e2423d8634 req-3a655792-f4ee-49be-9e0a-58079663384c tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_members [ 872.941268] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_members [ 872.941569] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3b380ca-ae52-4449-89ca-b2e647b635d9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.941693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.941741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.942020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.942290] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.942397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.942517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.942623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.942710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.942798] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.974664] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.974918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.975117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.975395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.975499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.975728] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.975885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.975963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.976170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.976251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.976339] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d6db365-2384-4e4f-98b7-13262fcd05f8 already deleted. [ 872.976415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d6db365-2384-4e4f-98b7-13262fcd05f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.264292] env[65678]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/domains/default/groups/393a6f14-3ce6-441b-a403-1993c47b58e3', 'data': {'id': '393a6f14-3ce6-441b-a403-1993c47b58e3', 'display_name': '393a6f14-3ce6-441b-a403-1993c47b58e3', 'path': '/infra/domains/default/groups/393a6f14-3ce6-441b-a403-1993c47b58e3', 'expression': [{'value': 'security_group|393a6f14-3ce6-441b-a403-1993c47b58e3', 'member_type': 'SegmentPort', 'key': 'Tag', 'operator': 'EQUALS', 'resource_type': 'Condition'}], 'tags': [{'scope': 'age', 'tag': 1763088211}, {'scope': 'revision_number', 'tag': None}], '_revision': 11}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 873.264481] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.put {{(pid=65678) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:122}} [ 873.331824] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: SUCCESS [ 873.332074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.332263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.332492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.332688] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.332816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.332952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.333203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.333289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.333390] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.380664] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.380915] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.381048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.381338] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.381592] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.381746] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.381870] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.382099] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.382242] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.382451] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.382561] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.382789] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.382789] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.382906] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.383095] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.383243] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.407619] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.407709] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.407853] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.408016] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.408346] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-6c680add-c078-4ddb-adc9-7e1947c423f8 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.408540] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-6c680add-c078-4ddb-adc9-7e1947c423f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.408659] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-6c680add-c078-4ddb-adc9-7e1947c423f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.409106] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-6c680add-c078-4ddb-adc9-7e1947c423f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.409240] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c680add-c078-4ddb-adc9-7e1947c423f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.445534] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.445750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.445885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.446158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.446408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.446547] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.446682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.446772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.446983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.447122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.447259] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 already deleted. [ 873.447371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.489138] env[65678]: INFO networking_nsxv3.common.synchronization [None req-07dfb274-375b-47b4-abaf-79565fcdc5b6 None None] Enqueued Resource ID: bc4746c7-bba1-41a9-bfdd-3fb137fce509 with Priority: HIGHEST for action port [ 873.489645] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc4746c7-bba1-41a9-bfdd-3fb137fce509 with Priority: HIGHEST for action port [ 873.489986] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc4746c7-bba1-41a9-bfdd-3fb137fce509 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.490129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc4746c7-bba1-41a9-bfdd-3fb137fce509" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.490192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc4746c7-bba1-41a9-bfdd-3fb137fce509" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.490447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc4746c7-bba1-41a9-bfdd-3fb137fce509" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.490530] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc4746c7-bba1-41a9-bfdd-3fb137fce509',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.835986] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.911998] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.912403] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.912532] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.912807] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.912952] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.913176] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 6c680add-c078-4ddb-adc9-7e1947c423f8 not found, creating... [ 873.913452] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.913615] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.913724] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.913960] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.914130] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.914413] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.914564] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.914675] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.914890] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.915043] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.915185] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 6c680add-c078-4ddb-adc9-7e1947c423f8 is going to be created. [ 873.938652] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.938808] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.938873] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.939124] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.939529] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.939607] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-6c680add-c078-4ddb-adc9-7e1947c423f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.993434] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc4746c7-bba1-41a9-bfdd-3fb137fce509 [ 873.993434] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.993434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.993434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.993989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.994040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.994122] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc4746c7-bba1-41a9-bfdd-3fb137fce509 already deleted. [ 873.994212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc4746c7-bba1-41a9-bfdd-3fb137fce509" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.311786] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 in Status: SUCCESS [ 874.311786] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 deletion is rescheduled due to dependency. [ 874.311786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.326536] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 in Status: SUCCESS [ 874.326536] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 deletion is rescheduled due to dependency. [ 874.326536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-394e9a35-6053-4366-8c10-efbb3bbed0b9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.338139] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.639047] env[65678]: INFO networking_nsxv3.common.synchronization [req-fe6a5ed2-502c-4a7e-92c8-20e2423d8634 req-d9ace3fd-6166-4eb2-895b-53fe45db176b service nova] Enqueued Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_rules [ 874.639047] env[65678]: INFO networking_nsxv3.common.synchronization [req-fe6a5ed2-502c-4a7e-92c8-20e2423d8634 req-d9ace3fd-6166-4eb2-895b-53fe45db176b service nova] Enqueued Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_members [ 874.639047] env[65678]: INFO networking_nsxv3.common.synchronization [req-fe6a5ed2-502c-4a7e-92c8-20e2423d8634 req-d9ace3fd-6166-4eb2-895b-53fe45db176b service nova] Enqueued Resource ID: 6c680add-c078-4ddb-adc9-7e1947c423f8 with Priority: HIGHEST for action port [ 874.639562] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_rules [ 874.639562] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_members [ 874.639562] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c680add-c078-4ddb-adc9-7e1947c423f8 with Priority: HIGHEST for action port [ 874.639780] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3b380ca-ae52-4449-89ca-b2e647b635d9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.639922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.640017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.641285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.641285] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.641863] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3b380ca-ae52-4449-89ca-b2e647b635d9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.641863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.641863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.642154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.642366] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.643161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.643161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.643161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.643161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.643161] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.646922] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c680add-c078-4ddb-adc9-7e1947c423f8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.646922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c680add-c078-4ddb-adc9-7e1947c423f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.646922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c680add-c078-4ddb-adc9-7e1947c423f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.646922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c680add-c078-4ddb-adc9-7e1947c423f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.646922] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c680add-c078-4ddb-adc9-7e1947c423f8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.840548] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.840905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.841198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.841532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.841728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.841912] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2164111b-0060-40e2-86c3-edfc4931cb24 is going to be updated. [ 874.877466] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.877466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.877466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.877466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.877466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.894913] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: IN_PROGRESS for 2s [ 875.148432] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3b380ca-ae52-4449-89ca-b2e647b635d9 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.148709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.148810] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.149648] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c680add-c078-4ddb-adc9-7e1947c423f8 with status ACTIVE [ 875.149842] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.149957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.150038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.154288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.154414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.154658] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.154785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.155227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.155227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.155227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.155408] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.155680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.155680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.155963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.155963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.155963] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c680add-c078-4ddb-adc9-7e1947c423f8 is going to be updated. [ 875.195588] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.195788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.195859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.196090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.196222] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.196386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c680add-c078-4ddb-adc9-7e1947c423f8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.326045] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.326513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.326760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.328145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.329990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.340087] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: IN_PROGRESS for 2s [ 875.658328] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.162116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.162116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.162116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.162627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.162627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.162627] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 is going to be created. [ 876.196745] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.199636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.199746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.201394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.201658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.219930] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 in Status: UNINITIALIZED for 2s [ 876.906648] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: SUCCESS [ 876.906876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.907264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.907544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.907757] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.907875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.907953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.908196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.908324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.908454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.908617] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.356790] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 in Status: SUCCESS [ 877.357188] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 deletion is rescheduled due to dependency. [ 877.357321] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.411209] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.411438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.411438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.411747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.412729] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.412729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.412729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.412729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.412729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.412729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.413383] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.413533] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.413639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.413824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.414024] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.414866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.414909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.418199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.418402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.418537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.418661] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.921330] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2164111b-0060-40e2-86c3-edfc4931cb24: rpc.has_security_group_logging(os_id): False [ 877.942784] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.942935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.943082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.943319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.968247] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.968247] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.968247] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.968247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.968803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.968803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.968803] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2164111b-0060-40e2-86c3-edfc4931cb24 is going to be updated. [ 878.036196] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.036196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.036196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.036196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.036196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.052670] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: IN_PROGRESS for 2s [ 878.231412] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 in Status: SUCCESS [ 878.231412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.231412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.231412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.231712] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.231712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.231712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.231866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.231866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.231936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.232017] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.735048] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.983152] env[65678]: INFO networking_nsxv3.common.synchronization [req-52b28c84-3431-4b29-b929-771d688eb370 req-5879180b-eed8-4662-af7c-f9fc72e78be9 tempest-MigrationsAdminTest-513313397 tempest-MigrationsAdminTest-513313397-project-member] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 878.984044] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 878.984421] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.984534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.984608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.984816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.984985] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.985107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.985170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.985330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.985427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.985521] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.239169] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3b380ca-ae52-4449-89ca-b2e647b635d9: rpc.has_security_group_logging(os_id): False [ 879.262493] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.262493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.262493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.262493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.262493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.262493] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.262493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.262493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.262493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.262493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.262493] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 is going to be created. [ 879.341182] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.341536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.341666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.341908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.342136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.357579] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 in Status: IN_PROGRESS for 2s [ 879.493558] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.997731] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.070345] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: SUCCESS [ 880.070692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.500028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.500028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.500028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.500311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.500311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.500403] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b is going to be updated. [ 880.532562] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.532798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.532856] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.533089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.533239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.544129] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: IN_PROGRESS for 2s [ 881.183711] env[65678]: INFO networking_nsxv3.common.synchronization [req-04c1a3f4-9733-4efb-8557-f44255cc00e2 req-74fa50f9-ffe4-443e-b493-8a48715d2d40 tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 881.183711] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 881.183711] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.185099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.185416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.185475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.186111] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.186111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.186111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.186111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.186313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.186313] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.372633] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 in Status: SUCCESS [ 881.373038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.554652] env[65678]: INFO networking_nsxv3.common.synchronization [req-04c1a3f4-9733-4efb-8557-f44255cc00e2 req-77185991-c74e-4b93-bfa5-81b7bdebc514 tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 881.555421] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 881.556652] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.556652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.689030] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.689173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.689173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.689430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.689534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.689749] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.689851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.689912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.690105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.690223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.690282] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be deleted. [ 881.725598] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.725598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.725598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.725891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.725891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.725990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.726147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.726671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.726671] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.726671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.726671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.726899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.726899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.726979] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.033112] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-694 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.033374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-694" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.033549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-694" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.033879] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-694" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.034245] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.034361] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.034408] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.034680] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.034839] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.035059] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.035172] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.035279] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.035385] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.035488] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.035591] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.035721] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.060599] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.060599] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 882.060599] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.060599] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-694" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.060599] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-d42d4121-fc32-4353-9278-d8d951a31d7b taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.060599] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-d42d4121-fc32-4353-9278-d8d951a31d7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.060599] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-d42d4121-fc32-4353-9278-d8d951a31d7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.061083] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-d42d4121-fc32-4353-9278-d8d951a31d7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.061083] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d42d4121-fc32-4353-9278-d8d951a31d7b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.230737] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.230737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.230737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.231468] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.231468] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.231587] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.231678] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.231756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.232033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.232176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.232288] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d already deleted. [ 882.232440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.557448] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: SUCCESS [ 882.557718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.564621] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.565907] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.566324] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.568347] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.568536] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.568727] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port d42d4121-fc32-4353-9278-d8d951a31d7b not found, creating... [ 882.569080] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.569278] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.569428] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.571713] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.571875] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.572211] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.572405] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.572544] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.572769] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.572908] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.573086] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: d42d4121-fc32-4353-9278-d8d951a31d7b is going to be created. [ 882.597434] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.597678] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.597826] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.598143] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.598375] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.598676] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-d42d4121-fc32-4353-9278-d8d951a31d7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.313762] env[65678]: INFO networking_nsxv3.common.synchronization [req-04c1a3f4-9733-4efb-8557-f44255cc00e2 req-e02d77c0-0baa-47cf-80ef-5aad7a46ea4c service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 883.314045] env[65678]: INFO networking_nsxv3.common.synchronization [req-04c1a3f4-9733-4efb-8557-f44255cc00e2 req-e02d77c0-0baa-47cf-80ef-5aad7a46ea4c service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 883.314117] env[65678]: INFO networking_nsxv3.common.synchronization [req-04c1a3f4-9733-4efb-8557-f44255cc00e2 req-e02d77c0-0baa-47cf-80ef-5aad7a46ea4c service nova] Enqueued Resource ID: d42d4121-fc32-4353-9278-d8d951a31d7b with Priority: HIGHEST for action port [ 883.314652] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 883.314781] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 883.314871] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d42d4121-fc32-4353-9278-d8d951a31d7b with Priority: HIGHEST for action port [ 883.315178] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.315277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.315342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.315538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.315614] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.316878] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.316999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.317080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.317253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.317395] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.317485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.317544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.317683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.317762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.317852] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.318767] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d42d4121-fc32-4353-9278-d8d951a31d7b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.318876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d42d4121-fc32-4353-9278-d8d951a31d7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.320077] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d42d4121-fc32-4353-9278-d8d951a31d7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.320077] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d42d4121-fc32-4353-9278-d8d951a31d7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.320077] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d42d4121-fc32-4353-9278-d8d951a31d7b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.802345] env[65678]: INFO networking_nsxv3.common.synchronization [req-6a35d758-1758-42ec-ae08-332fc539e786 req-6735e4b1-aba0-42c6-9e04-6192602dcafb tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 883.802757] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 883.804459] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.804459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.804459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.804459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.804459] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.804459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.804459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.804459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.804459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.804459] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.822248] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.822248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.822923] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.828859] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d42d4121-fc32-4353-9278-d8d951a31d7b with status ACTIVE [ 883.829198] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.829336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.829406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.829611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.829690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.829866] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.829964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.830041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.830198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.830271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.830453] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.830546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.830617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.830745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.830821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.830924] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d42d4121-fc32-4353-9278-d8d951a31d7b is going to be updated. [ 883.855492] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.855675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.855757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.856532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.856717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.856979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d42d4121-fc32-4353-9278-d8d951a31d7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.307528] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.307719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.307719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.308136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.308213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.308542] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.308683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.308770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.308958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.309077] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.309190] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 884.325968] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.336773] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.337170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.337270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.337487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.337722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.349308] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 884.370881] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.370881] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-232" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.370881] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-232" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.370881] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-232" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.370881] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.371509] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.371787] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.372207] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.373960] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.373960] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.373960] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.373960] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.373960] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.373960] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.373960] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.373960] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.396330] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.396504] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.396647] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.396823] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-232" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.397144] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.397321] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.397442] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.397758] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.397888] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f8e3b9-06c1-4d2e-865e-7b262d29512f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.526606] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.526800] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.526969] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.527360] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.527733] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.527941] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.528094] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.528334] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.528478] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.528686] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.528795] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.528901] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.529015] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.529157] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.529264] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.529391] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.548782] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.548942] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.549093] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.549281] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.549595] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-3f43a015-f7ae-4c1c-92c4-e6e83151519e taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.549762] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-3f43a015-f7ae-4c1c-92c4-e6e83151519e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.549879] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-3f43a015-f7ae-4c1c-92c4-e6e83151519e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.550240] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-3f43a015-f7ae-4c1c-92c4-e6e83151519e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.550382] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f43a015-f7ae-4c1c-92c4-e6e83151519e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.830626] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.830808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.830808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.831109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.831566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.831566] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be created. [ 884.862843] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.863098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.863169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.863480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.863652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.875488] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: UNINITIALIZED for 2s [ 884.900732] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.901099] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.901313] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.901776] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.902044] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.902346] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port b7f8e3b9-06c1-4d2e-865e-7b262d29512f not found, creating... [ 884.902793] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.903138] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.903344] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.903741] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.904012] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.904559] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.905032] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.905277] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.905673] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.905942] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.906156] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: b7f8e3b9-06c1-4d2e-865e-7b262d29512f is going to be created. [ 884.927793] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.928026] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.928155] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.928518] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.928776] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.929085] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.054101] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.054465] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.054677] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.055130] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.055433] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.055610] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 3f43a015-f7ae-4c1c-92c4-e6e83151519e not found, creating... [ 885.056125] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.056340] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.056468] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.057029] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.057029] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.057268] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.057451] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.057601] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.058108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.058108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.058217] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 3f43a015-f7ae-4c1c-92c4-e6e83151519e is going to be created. [ 885.089308] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.089509] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.089683] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.089923] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.090167] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.090415] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-3f43a015-f7ae-4c1c-92c4-e6e83151519e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.633706] env[65678]: INFO networking_nsxv3.common.synchronization [req-04c1a3f4-9733-4efb-8557-f44255cc00e2 req-411d5a72-c06e-4e7f-8ea3-b780d2efb2d0 service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 885.633955] env[65678]: INFO networking_nsxv3.common.synchronization [req-04c1a3f4-9733-4efb-8557-f44255cc00e2 req-411d5a72-c06e-4e7f-8ea3-b780d2efb2d0 service nova] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 885.633955] env[65678]: INFO networking_nsxv3.common.synchronization [req-04c1a3f4-9733-4efb-8557-f44255cc00e2 req-411d5a72-c06e-4e7f-8ea3-b780d2efb2d0 service nova] Enqueued Resource ID: b7f8e3b9-06c1-4d2e-865e-7b262d29512f with Priority: HIGHEST for action port [ 885.634405] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_rules [ 885.634548] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 885.634674] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7f8e3b9-06c1-4d2e-865e-7b262d29512f with Priority: HIGHEST for action port [ 885.635666] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.635817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.636225] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.636409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.636850] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.641828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.641941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.642168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.642270] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f8e3b9-06c1-4d2e-865e-7b262d29512f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.813978] env[65678]: INFO networking_nsxv3.common.synchronization [req-6a35d758-1758-42ec-ae08-332fc539e786 req-1239b20a-9dd7-4bdb-a927-2a4781425d5a service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 885.813978] env[65678]: INFO networking_nsxv3.common.synchronization [req-6a35d758-1758-42ec-ae08-332fc539e786 req-1239b20a-9dd7-4bdb-a927-2a4781425d5a service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 885.813978] env[65678]: INFO networking_nsxv3.common.synchronization [req-6a35d758-1758-42ec-ae08-332fc539e786 req-1239b20a-9dd7-4bdb-a927-2a4781425d5a service nova] Enqueued Resource ID: 3f43a015-f7ae-4c1c-92c4-e6e83151519e with Priority: HIGHEST for action port [ 885.813978] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 885.813978] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 885.813978] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f43a015-f7ae-4c1c-92c4-e6e83151519e with Priority: HIGHEST for action port [ 885.813978] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.814452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.814452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.814790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.814941] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.815965] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.816976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.819444] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f43a015-f7ae-4c1c-92c4-e6e83151519e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.819699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f43a015-f7ae-4c1c-92c4-e6e83151519e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.821673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f43a015-f7ae-4c1c-92c4-e6e83151519e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.821673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f43a015-f7ae-4c1c-92c4-e6e83151519e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.821673] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f43a015-f7ae-4c1c-92c4-e6e83151519e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.145415] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7f8e3b9-06c1-4d2e-865e-7b262d29512f with status ACTIVE [ 886.145671] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.145814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.145887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.146121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.146224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.146407] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.146510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.146576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.146726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.146911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.146975] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.147081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.147140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.147282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.147356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.147438] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7f8e3b9-06c1-4d2e-865e-7b262d29512f is going to be updated. [ 886.173167] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.173316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.173612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.173612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.173786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.173880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7f8e3b9-06c1-4d2e-865e-7b262d29512f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.322751] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.323033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.323181] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f43a015-f7ae-4c1c-92c4-e6e83151519e with status ACTIVE [ 886.323323] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.323439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.323502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.323730] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.323818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.324056] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.324168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.324201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.324344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.324425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.324621] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.324708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.324772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.324921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.324991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.325094] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f43a015-f7ae-4c1c-92c4-e6e83151519e is going to be updated. [ 886.353972] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.354135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.354211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.354408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.354558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.354729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f43a015-f7ae-4c1c-92c4-e6e83151519e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.366928] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 886.366928] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c deletion is rescheduled due to dependency. [ 886.366928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.366928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.367171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.367546] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.367546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.367546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.367783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.367887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.367988] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.870711] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.886731] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 886.888035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.888035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.888035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.888035] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.888035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.888035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.888035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.888035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.888405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.888405] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.890322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.890322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.891732] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.891825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.891884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.892101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.892192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.892327] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.295015] env[65678]: INFO networking_nsxv3.common.synchronization [None req-98deb6cf-dad5-45be-b74d-2d7bb7bc8206 None None] Enqueued Resource ID: e700e9b6-ae88-4fd6-8b6c-0213957bdf5e with Priority: HIGHEST for action port [ 887.295580] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e700e9b6-ae88-4fd6-8b6c-0213957bdf5e with Priority: HIGHEST for action port [ 887.295883] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-e700e9b6-ae88-4fd6-8b6c-0213957bdf5e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.296011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e700e9b6-ae88-4fd6-8b6c-0213957bdf5e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.296187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e700e9b6-ae88-4fd6-8b6c-0213957bdf5e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.296448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e700e9b6-ae88-4fd6-8b6c-0213957bdf5e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.296524] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e700e9b6-ae88-4fd6-8b6c-0213957bdf5e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.375638] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.395913] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.395913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.395913] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.803481] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e700e9b6-ae88-4fd6-8b6c-0213957bdf5e [ 887.803481] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.803481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.803481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.803481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.803481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.803481] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e700e9b6-ae88-4fd6-8b6c-0213957bdf5e already deleted. [ 887.803481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e700e9b6-ae88-4fd6-8b6c-0213957bdf5e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.885446] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.885446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.885446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.885446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.885446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.885446] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 887.898982] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.920256] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.920425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.920461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.920673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.920913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.931165] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 888.403210] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.403210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.403210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.403210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.403210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.403210] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 888.442274] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.442451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.442586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.442706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.442843] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.455812] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 888.781388] env[65678]: INFO networking_nsxv3.common.synchronization [req-3cfcb922-bf41-4331-8897-61d761f2eb1a req-6c65994b-debf-418f-924e-63cc31d3b719 tempest-SecurityGroupRulesTestJSON-198259628 tempest-SecurityGroupRulesTestJSON-198259628-project-member] Enqueued Resource ID: d496b61e-bd82-4b5b-961d-2104502b8ed1 with Priority: HIGHEST for action security_group_rules [ 888.782096] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d496b61e-bd82-4b5b-961d-2104502b8ed1 with Priority: HIGHEST for action security_group_rules [ 888.782518] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d496b61e-bd82-4b5b-961d-2104502b8ed1 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.784830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d496b61e-bd82-4b5b-961d-2104502b8ed1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.784830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d496b61e-bd82-4b5b-961d-2104502b8ed1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.784830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d496b61e-bd82-4b5b-961d-2104502b8ed1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.784830] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d496b61e-bd82-4b5b-961d-2104502b8ed1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.189561] env[65678]: INFO networking_nsxv3.common.synchronization [req-8bc270ef-6ac8-4a85-9294-73a15a46ec89 req-a745fba9-f75f-4157-83e1-745db7c7d1b9 tempest-SecurityGroupRulesTestJSON-198259628 tempest-SecurityGroupRulesTestJSON-198259628-project-member] Enqueued Resource ID: 785664b9-4142-4dae-9d77-08b6f34dfbbd with Priority: HIGHEST for action security_group_rules [ 889.190388] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 785664b9-4142-4dae-9d77-08b6f34dfbbd with Priority: HIGHEST for action security_group_rules [ 889.190388] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-785664b9-4142-4dae-9d77-08b6f34dfbbd taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.190388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-785664b9-4142-4dae-9d77-08b6f34dfbbd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.190388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-785664b9-4142-4dae-9d77-08b6f34dfbbd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.190600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-785664b9-4142-4dae-9d77-08b6f34dfbbd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.190822] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('785664b9-4142-4dae-9d77-08b6f34dfbbd',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.307316] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.307465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.307564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.307766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.307854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.307949] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d496b61e-bd82-4b5b-961d-2104502b8ed1 already deleted. [ 889.308236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d496b61e-bd82-4b5b-961d-2104502b8ed1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.715103] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.715275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.715322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.715526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.715612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.715710] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 785664b9-4142-4dae-9d77-08b6f34dfbbd already deleted. [ 889.715798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-785664b9-4142-4dae-9d77-08b6f34dfbbd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.770160] env[65678]: INFO networking_nsxv3.common.synchronization [None req-b6d5b447-3c49-4edc-ac5c-5e09cc8d259f None None] Enqueued Resource ID: a2d3b08d-0511-4961-8770-ff47a1575c76 with Priority: HIGHEST for action port [ 889.770160] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2d3b08d-0511-4961-8770-ff47a1575c76 with Priority: HIGHEST for action port [ 889.770500] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2d3b08d-0511-4961-8770-ff47a1575c76 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.770640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2d3b08d-0511-4961-8770-ff47a1575c76" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.770723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2d3b08d-0511-4961-8770-ff47a1575c76" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.770969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2d3b08d-0511-4961-8770-ff47a1575c76" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.771072] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2d3b08d-0511-4961-8770-ff47a1575c76',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.945552] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 889.945552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.945552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.945552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.945552] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.945552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.945552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.945552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.945552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.945552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.946021] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.272734] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2d3b08d-0511-4961-8770-ff47a1575c76 [ 890.273052] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.273367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.273604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.273882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.273983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.274128] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2d3b08d-0511-4961-8770-ff47a1575c76 already deleted. [ 890.274226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2d3b08d-0511-4961-8770-ff47a1575c76" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.279966] env[65678]: INFO networking_nsxv3.common.synchronization [req-6d454c76-7b19-4ed2-9bc9-74e03fd87c95 req-c4f1ccca-8ba6-4c8f-8473-76ea04ee9db3 tempest-SecurityGroupRulesTestJSON-198259628 tempest-SecurityGroupRulesTestJSON-198259628-project-member] Enqueued Resource ID: c8be79fe-8a18-44f2-a287-1c95b548365b with Priority: HIGHEST for action security_group_rules [ 890.280548] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8be79fe-8a18-44f2-a287-1c95b548365b with Priority: HIGHEST for action security_group_rules [ 890.281141] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8be79fe-8a18-44f2-a287-1c95b548365b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.281141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8be79fe-8a18-44f2-a287-1c95b548365b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.281270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8be79fe-8a18-44f2-a287-1c95b548365b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.281978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8be79fe-8a18-44f2-a287-1c95b548365b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.281978] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8be79fe-8a18-44f2-a287-1c95b548365b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.451691] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.452169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.455020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.455020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.455020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.455020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.455697] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.468714] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 890.468940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.469643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.469643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.469643] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.469786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.469786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.469913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.469989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.470083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.470250] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.470337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.470397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.470591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.470737] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.470849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.471745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.472051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.472175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.472281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.472421] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.806091] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.806233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.806338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.806568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.806731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.806790] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8be79fe-8a18-44f2-a287-1c95b548365b already deleted. [ 890.806874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8be79fe-8a18-44f2-a287-1c95b548365b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.959688] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c: rpc.has_security_group_logging(os_id): False [ 890.974861] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e24b48ad-1ed5-4566-912b-a63687a8de4d: rpc.has_security_group_logging(os_id): False [ 890.980016] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.980237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.980296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.980500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.980596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.980798] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.980959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.981584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.981584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.981584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.981584] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.981771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.981884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.982252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.982252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.982370] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.982436] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.982479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.982599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.982673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.982758] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 890.996727] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.996727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.996727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.996727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.997032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.997063] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.997560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.997560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.997560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.997560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.997724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.997724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.997815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.997903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.997982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.998262] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.998369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.998430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.998639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.998639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.998745] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be created. [ 891.079036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.079036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.079036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.079368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.079576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.082272] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.082466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.082546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.082746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.082924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.105959] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 891.106846] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 891.373292] env[65678]: INFO networking_nsxv3.common.synchronization [req-c54e39cb-eb9a-4758-96d5-42a471410232 req-bdcf2a0e-3ceb-4840-9e7c-d77162eff977 tempest-SecurityGroupRulesTestJSON-198259628 tempest-SecurityGroupRulesTestJSON-198259628-project-member] Enqueued Resource ID: ead0f472-a821-4ddc-98c1-173a8938e303 with Priority: HIGHEST for action security_group_rules [ 891.373292] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ead0f472-a821-4ddc-98c1-173a8938e303 with Priority: HIGHEST for action security_group_rules [ 891.373526] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ead0f472-a821-4ddc-98c1-173a8938e303 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.373526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ead0f472-a821-4ddc-98c1-173a8938e303" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.373603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ead0f472-a821-4ddc-98c1-173a8938e303" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.373931] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ead0f472-a821-4ddc-98c1-173a8938e303" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.373931] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ead0f472-a821-4ddc-98c1-173a8938e303',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.406018] env[65678]: INFO networking_nsxv3.common.synchronization [req-80e5d0e9-3a56-4f88-95fb-53fc3e1637b4 req-4d797272-efb1-46af-a69a-2fa3ab531d23 tempest-ServersAdminNegativeTestJSON-1032160483 tempest-ServersAdminNegativeTestJSON-1032160483-project-member] Enqueued Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 891.406018] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 891.406018] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.406291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.406291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.406721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.406721] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.406721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.406721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.406904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.406904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.407285] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.846511] env[65678]: INFO networking_nsxv3.common.synchronization [req-d302ead4-f357-4a80-b79c-8c25273dc487 req-7bf30e55-397d-4a2a-a58d-9c60b1b99cdf tempest-SecurityGroupRulesTestJSON-198259628 tempest-SecurityGroupRulesTestJSON-198259628-project-member] Enqueued Resource ID: ba908753-1b0f-400a-894a-42388f731771 with Priority: HIGHEST for action security_group_rules [ 891.847183] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba908753-1b0f-400a-894a-42388f731771 with Priority: HIGHEST for action security_group_rules [ 891.847764] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba908753-1b0f-400a-894a-42388f731771 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.847957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.848171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.848387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.848774] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba908753-1b0f-400a-894a-42388f731771',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.897028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.897214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.897336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.897514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.897611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.897715] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ead0f472-a821-4ddc-98c1-173a8938e303 already deleted. [ 891.897827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ead0f472-a821-4ddc-98c1-173a8938e303" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.909796] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.983654] env[65678]: INFO networking_nsxv3.common.synchronization [req-86b9f3f0-db20-4c4b-aba5-390dc64c0cf4 req-daf4186c-cf94-4072-9fb9-f5f4ee1cd4ef tempest-SecurityGroupRulesTestJSON-198259628 tempest-SecurityGroupRulesTestJSON-198259628-project-member] Enqueued Resource ID: ba908753-1b0f-400a-894a-42388f731771 with Priority: HIGHEST for action security_group_rules [ 891.984814] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba908753-1b0f-400a-894a-42388f731771 with Priority: HIGHEST for action security_group_rules [ 891.984948] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba908753-1b0f-400a-894a-42388f731771 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.984995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.194162] env[65678]: INFO networking_nsxv3.common.synchronization [req-d5093e27-3cbe-4bd8-a9d8-48b7623ba62f req-b13dd160-e93f-4b86-bbe5-25c6c5f51698 tempest-SecurityGroupRulesTestJSON-198259628 tempest-SecurityGroupRulesTestJSON-198259628-project-member] Enqueued Resource ID: ba908753-1b0f-400a-894a-42388f731771 with Priority: HIGHEST for action security_group_rules [ 892.195098] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba908753-1b0f-400a-894a-42388f731771 with Priority: HIGHEST for action security_group_rules [ 892.195368] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba908753-1b0f-400a-894a-42388f731771 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.195368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.372651] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.372651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.372651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.372985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.373208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.374709] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba908753-1b0f-400a-894a-42388f731771 already deleted. [ 892.374709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.374709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.374709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.374709] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba908753-1b0f-400a-894a-42388f731771',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.411879] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.901833] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.902111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.902223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.902434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.902571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.902673] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba908753-1b0f-400a-894a-42388f731771 already deleted. [ 892.902762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.903544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.903890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.903890] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba908753-1b0f-400a-894a-42388f731771',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.915053] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.915232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.915284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.915535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.915629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.915731] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2164111b-0060-40e2-86c3-edfc4931cb24 is going to be updated. [ 892.952693] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.952903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.952961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.953282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.953484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.967613] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: IN_PROGRESS for 2s [ 893.125015] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 893.125015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.125568] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 893.125802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.126227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.127079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.127774] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.431593] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.431593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.431593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.431593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.431593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.431593] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba908753-1b0f-400a-894a-42388f731771 already deleted. [ 893.433049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba908753-1b0f-400a-894a-42388f731771" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.631183] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.631777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.632143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.635000] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.635000] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.635000] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.635000] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.635000] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.635000] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.635000] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.635000] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.139996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.140235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.140327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.140619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.140849] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.141761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.141877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.142353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.142544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.142751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.143268] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.143268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.143418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.143567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.143835] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.144164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.144305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.144767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.144923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.145143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.145349] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.648109] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e24b48ad-1ed5-4566-912b-a63687a8de4d: rpc.has_security_group_logging(os_id): False [ 894.666782] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.666966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.667053] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.667446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.667446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.667612] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.667672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.667724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.667850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.667926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.668113] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.668206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.668268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.668467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.668543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.668753] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.668851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.668912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.669461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.669560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.669654] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 894.734802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.734997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.734997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.735171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.735467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.758129] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 894.979999] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: SUCCESS [ 894.980255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.790303] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 896.790599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.195396] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 897.195558] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 898.277175] env[65678]: INFO networking_nsxv3.common.synchronization [None req-b10c731f-e8d2-41be-ab5e-f2a272e84494 None None] Enqueued Resource ID: 32ba4bc7-d4a2-458f-9519-f8ef98392c7d with Priority: HIGHEST for action port [ 898.277175] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ba4bc7-d4a2-458f-9519-f8ef98392c7d with Priority: HIGHEST for action port [ 898.277175] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-32ba4bc7-d4a2-458f-9519-f8ef98392c7d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.277175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32ba4bc7-d4a2-458f-9519-f8ef98392c7d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.277175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32ba4bc7-d4a2-458f-9519-f8ef98392c7d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.277175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32ba4bc7-d4a2-458f-9519-f8ef98392c7d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.277175] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32ba4bc7-d4a2-458f-9519-f8ef98392c7d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.454667] env[65678]: INFO networking_nsxv3.common.synchronization [None req-4d3bd920-8ded-4c68-b1fb-02c7fda5650b None None] Enqueued Resource ID: b762a901-406a-4d63-ab3e-87f477cf5f2b with Priority: HIGHEST for action port [ 898.455730] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b762a901-406a-4d63-ab3e-87f477cf5f2b with Priority: HIGHEST for action port [ 898.458100] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b762a901-406a-4d63-ab3e-87f477cf5f2b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.458100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b762a901-406a-4d63-ab3e-87f477cf5f2b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.458100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b762a901-406a-4d63-ab3e-87f477cf5f2b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.458100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b762a901-406a-4d63-ab3e-87f477cf5f2b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.458100] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b762a901-406a-4d63-ab3e-87f477cf5f2b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.780084] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32ba4bc7-d4a2-458f-9519-f8ef98392c7d [ 898.780461] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.780461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.780608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.780753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.780849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.780986] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32ba4bc7-d4a2-458f-9519-f8ef98392c7d already deleted. [ 898.781135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32ba4bc7-d4a2-458f-9519-f8ef98392c7d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.961743] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b762a901-406a-4d63-ab3e-87f477cf5f2b [ 898.961862] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.961928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.964994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.964994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.964994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.964994] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b762a901-406a-4d63-ab3e-87f477cf5f2b already deleted. [ 898.964994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b762a901-406a-4d63-ab3e-87f477cf5f2b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.441284] env[65678]: INFO networking_nsxv3.common.synchronization [None req-c1a71033-4816-410a-a50e-3b422d5f6e25 None None] Enqueued Resource ID: 8d947230-fb93-4454-8415-4d4c7be36cf8 with Priority: HIGHEST for action port [ 899.441943] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d947230-fb93-4454-8415-4d4c7be36cf8 with Priority: HIGHEST for action port [ 899.443217] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d947230-fb93-4454-8415-4d4c7be36cf8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.443217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d947230-fb93-4454-8415-4d4c7be36cf8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.443217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d947230-fb93-4454-8415-4d4c7be36cf8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.443217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d947230-fb93-4454-8415-4d4c7be36cf8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.443217] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d947230-fb93-4454-8415-4d4c7be36cf8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.676736] env[65678]: INFO networking_nsxv3.common.synchronization [req-0a9a358b-cc57-44b5-a709-e869d846031b req-36a83e45-891c-4126-9a2f-cb9690f4c357 tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 899.680146] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 899.680146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.680146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.680146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.680146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.680146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.680387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.680387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.680495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.680573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.680708] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.948496] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d947230-fb93-4454-8415-4d4c7be36cf8 [ 899.948496] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.948496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.948496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.948496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.948724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.948724] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d947230-fb93-4454-8415-4d4c7be36cf8 already deleted. [ 899.948724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d947230-fb93-4454-8415-4d4c7be36cf8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.949863] env[65678]: INFO networking_nsxv3.common.synchronization [req-13f3ec03-6f5f-4764-af8b-6a74628a6962 req-144b7971-7b3d-4feb-b036-e7bfbca93a8f tempest-ServerTagsTestJSON-978582925 tempest-ServerTagsTestJSON-978582925-project-member] Enqueued Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGHEST for action security_group_members [ 899.950267] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGHEST for action security_group_members [ 899.950554] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97df514-272c-47bf-a99a-d9d5458cd9ab taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.950777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.951451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.951451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.951451] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.951451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.951451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.951648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.951648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.951750] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e97df514-272c-47bf-a99a-d9d5458cd9ab',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.041654] env[65678]: INFO networking_nsxv3.common.synchronization [req-0a9a358b-cc57-44b5-a709-e869d846031b req-146d5729-8c68-4715-8fe0-b3425bc6cd1a tempest-ServersTestMultiNic-2070706256 tempest-ServersTestMultiNic-2070706256-project-member] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 900.043068] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGHEST for action security_group_members [ 900.043068] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.043068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.185198] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.422034] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.423250] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-706" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.423438] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-706" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.423776] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-706" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.424079] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.424242] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.424356] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.424583] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.424724] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.424932] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.425080] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.425712] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.425712] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.425712] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.425712] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.425712] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.449123] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.449123] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 900.449123] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.451081] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-706" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.451081] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-c81b1713-222f-4b49-94c1-02f75bf69327 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.451081] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-c81b1713-222f-4b49-94c1-02f75bf69327" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.451081] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-c81b1713-222f-4b49-94c1-02f75bf69327" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.451081] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-c81b1713-222f-4b49-94c1-02f75bf69327" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.451081] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c81b1713-222f-4b49-94c1-02f75bf69327',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.455747] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.456097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.456283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.457031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.457031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.457031] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.457031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.457301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.457385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.458030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.458030] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e97df514-272c-47bf-a99a-d9d5458cd9ab already deleted. [ 900.458030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.493349] env[65678]: INFO networking_nsxv3.common.synchronization [None req-39a71c53-78de-48ee-9d4c-61dedc6113c5 None None] Enqueued Resource ID: 921b631a-673d-4073-a8f5-35d88a29fadc with Priority: HIGHEST for action port [ 900.493349] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 921b631a-673d-4073-a8f5-35d88a29fadc with Priority: HIGHEST for action port [ 900.493349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-921b631a-673d-4073-a8f5-35d88a29fadc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.493349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-921b631a-673d-4073-a8f5-35d88a29fadc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.493349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-921b631a-673d-4073-a8f5-35d88a29fadc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.493349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-921b631a-673d-4073-a8f5-35d88a29fadc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.493349] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('921b631a-673d-4073-a8f5-35d88a29fadc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.688747] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.953467] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.953703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.953827] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.954138] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.954288] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.954442] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port c81b1713-222f-4b49-94c1-02f75bf69327 not found, creating... [ 900.956580] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.956782] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.956901] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.960384] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.960592] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.961965] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.961965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.961965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.961965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.961965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.961965] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: c81b1713-222f-4b49-94c1-02f75bf69327 is going to be created. [ 900.985941] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.986336] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.986594] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.986967] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.986967] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.987315] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-c81b1713-222f-4b49-94c1-02f75bf69327" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.996997] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 921b631a-673d-4073-a8f5-35d88a29fadc [ 900.996997] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.996997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.997193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.997371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.997494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.997620] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:921b631a-673d-4073-a8f5-35d88a29fadc already deleted. [ 900.997716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-921b631a-673d-4073-a8f5-35d88a29fadc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.194535] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.194685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.194757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.194970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.195073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.195173] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 901.227190] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.227190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.227190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.227190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.227190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.237059] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 901.348361] env[65678]: INFO networking_nsxv3.common.synchronization [None req-475bb4bc-c554-4844-92c3-45a9cee2c2fa tempest-ServersTestManualDisk-33820034 tempest-ServersTestManualDisk-33820034-project-member] Enqueued Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_rules [ 901.349090] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_rules [ 901.349536] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92e8fca5-1dcf-494d-a489-044a26543bc2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.349536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.349536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.350474] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.350474] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.510862] env[65678]: INFO networking_nsxv3.common.synchronization [None req-460a322b-713a-4f8e-9199-304c13a5bb31 tempest-ServersTestManualDisk-33820034 tempest-ServersTestManualDisk-33820034-project-member] Enqueued Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_rules [ 901.511389] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_rules [ 901.511870] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92e8fca5-1dcf-494d-a489-044a26543bc2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.511870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.747572] env[65678]: INFO networking_nsxv3.common.synchronization [req-13f3ec03-6f5f-4764-af8b-6a74628a6962 req-f4e71774-7e52-4235-b7ea-bd0560b941a4 service nova] Enqueued Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGHEST for action security_group_rules [ 901.747916] env[65678]: INFO networking_nsxv3.common.synchronization [req-13f3ec03-6f5f-4764-af8b-6a74628a6962 req-f4e71774-7e52-4235-b7ea-bd0560b941a4 service nova] Enqueued Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGHEST for action security_group_members [ 901.748140] env[65678]: INFO networking_nsxv3.common.synchronization [req-13f3ec03-6f5f-4764-af8b-6a74628a6962 req-f4e71774-7e52-4235-b7ea-bd0560b941a4 service nova] Enqueued Resource ID: c81b1713-222f-4b49-94c1-02f75bf69327 with Priority: HIGHEST for action port [ 901.748712] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGHEST for action security_group_rules [ 901.748852] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGHEST for action security_group_members [ 901.748947] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c81b1713-222f-4b49-94c1-02f75bf69327 with Priority: HIGHEST for action port [ 901.749771] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e97df514-272c-47bf-a99a-d9d5458cd9ab taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.749977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.750037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.750429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.750429] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e97df514-272c-47bf-a99a-d9d5458cd9ab',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.752087] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97df514-272c-47bf-a99a-d9d5458cd9ab taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.752273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.752326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.752668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.752668] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.752750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.752795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.752943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.753397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.753397] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e97df514-272c-47bf-a99a-d9d5458cd9ab',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.756086] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c81b1713-222f-4b49-94c1-02f75bf69327 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.756302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c81b1713-222f-4b49-94c1-02f75bf69327" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.756377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c81b1713-222f-4b49-94c1-02f75bf69327" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.756550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c81b1713-222f-4b49-94c1-02f75bf69327" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.756631] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c81b1713-222f-4b49-94c1-02f75bf69327',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.881722] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.881940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.881940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.882166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.882254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.882347] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 already deleted. [ 901.882425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.882953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.883175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.883288] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.080429] env[65678]: INFO networking_nsxv3.common.synchronization [None req-7ad96474-9476-45ea-ad5f-c51ba77c386c None None] Enqueued Resource ID: 7520f420-0d26-4c47-8a5d-182ee1271315 with Priority: HIGHEST for action port [ 902.081066] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7520f420-0d26-4c47-8a5d-182ee1271315 with Priority: HIGHEST for action port [ 902.081384] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-7520f420-0d26-4c47-8a5d-182ee1271315 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.081892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7520f420-0d26-4c47-8a5d-182ee1271315" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.081892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7520f420-0d26-4c47-8a5d-182ee1271315" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.081892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7520f420-0d26-4c47-8a5d-182ee1271315" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.081892] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7520f420-0d26-4c47-8a5d-182ee1271315',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.192863] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e252a6a7-9af1-42c0-b809-932919c68578 None None] Enqueued Resource ID: 23959c73-da72-4ed1-831f-81b8a7ee09f2 with Priority: HIGHEST for action port [ 902.193512] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23959c73-da72-4ed1-831f-81b8a7ee09f2 with Priority: HIGHEST for action port [ 902.193816] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-23959c73-da72-4ed1-831f-81b8a7ee09f2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.193939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23959c73-da72-4ed1-831f-81b8a7ee09f2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.194050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23959c73-da72-4ed1-831f-81b8a7ee09f2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.195275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23959c73-da72-4ed1-831f-81b8a7ee09f2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.195275] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23959c73-da72-4ed1-831f-81b8a7ee09f2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.253149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97df514-272c-47bf-a99a-d9d5458cd9ab taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.253149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.258304] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e97df514-272c-47bf-a99a-d9d5458cd9ab',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.259679] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c81b1713-222f-4b49-94c1-02f75bf69327 with status ACTIVE [ 902.259889] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.260026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.260459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.260459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.260459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.260678] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.260768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.260768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.261347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.261455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.262866] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.262866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.262866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.262866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.262866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.262866] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c81b1713-222f-4b49-94c1-02f75bf69327 is going to be updated. [ 902.288932] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.288932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.289058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.289213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.289357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.293596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c81b1713-222f-4b49-94c1-02f75bf69327" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.414876] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.416063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.416237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.416479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.416564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.416701] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 already deleted. [ 902.416771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.553151] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-544 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.553151] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.553151] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.553151] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.553151] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.553151] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.553151] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.553151] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.553151] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.553151] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.553151] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.553151] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.553151] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.553968] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.553968] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.553968] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.579041] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.579041] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.579041] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.579041] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.579041] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-6c02b558-4061-4814-87d2-971e99c2bcce taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.579041] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.579041] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.579804] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.579804] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c02b558-4061-4814-87d2-971e99c2bcce',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.584185] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7520f420-0d26-4c47-8a5d-182ee1271315 [ 902.584292] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.584410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.584476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.584656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.584734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.584821] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7520f420-0d26-4c47-8a5d-182ee1271315 already deleted. [ 902.584899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7520f420-0d26-4c47-8a5d-182ee1271315" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.698713] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23959c73-da72-4ed1-831f-81b8a7ee09f2 [ 902.699466] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.699466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.699466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.699466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.699466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.699466] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23959c73-da72-4ed1-831f-81b8a7ee09f2 already deleted. [ 902.699466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23959c73-da72-4ed1-831f-81b8a7ee09f2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.766229] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e97df514-272c-47bf-a99a-d9d5458cd9ab',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.081292] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.081505] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.081632] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.081906] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.082599] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.083687] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.083687] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.083687] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.083821] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.083991] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.084344] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.084540] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.084658] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.084878] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.085017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.085173] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 6c02b558-4061-4814-87d2-971e99c2bcce is going to be updated. [ 903.124452] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.124967] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.125345] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.126137] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.126730] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.127411] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.252439] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 903.252439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.252680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.252945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.253297] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.253484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.253598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.253855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.253995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.254249] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.268387] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.268697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.268809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.269382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.269382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.269488] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e97df514-272c-47bf-a99a-d9d5458cd9ab is going to be created. [ 903.300046] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.300046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.300234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.300454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.300576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.312960] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e97df514-272c-47bf-a99a-d9d5458cd9ab in Status: UNINITIALIZED for 2s [ 903.757062] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.757525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.757525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.757626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.757671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.757891] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.757986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.758057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.758220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.758295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.758383] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be updated. [ 903.796078] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.797152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.797152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.797152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.797152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.809947] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: IN_PROGRESS for 2s [ 903.909233] env[65678]: INFO networking_nsxv3.common.synchronization [req-154935b1-c167-4670-995e-76747026b4ba req-7aff98be-bcc3-4c93-9ccb-1d889d9af07a service nova] Enqueued Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_rules [ 903.909481] env[65678]: INFO networking_nsxv3.common.synchronization [req-154935b1-c167-4670-995e-76747026b4ba req-7aff98be-bcc3-4c93-9ccb-1d889d9af07a service nova] Enqueued Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_members [ 903.909648] env[65678]: INFO networking_nsxv3.common.synchronization [req-154935b1-c167-4670-995e-76747026b4ba req-7aff98be-bcc3-4c93-9ccb-1d889d9af07a service nova] Enqueued Resource ID: 6c02b558-4061-4814-87d2-971e99c2bcce with Priority: HIGHEST for action port [ 903.911022] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_rules [ 903.911179] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_members [ 903.911321] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c02b558-4061-4814-87d2-971e99c2bcce with Priority: HIGHEST for action port [ 903.911683] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.911830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.911913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.912174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.912280] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.913789] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.913920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.913991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.914357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.914665] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.914820] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.914936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.915195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.915502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.915502] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.917923] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c02b558-4061-4814-87d2-971e99c2bcce taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.921869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.921869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.921869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.921869] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c02b558-4061-4814-87d2-971e99c2bcce',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.414478] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.414950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.418133] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.424052] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c02b558-4061-4814-87d2-971e99c2bcce with status ACTIVE [ 904.424276] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.424406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.424470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.424679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.424761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.424930] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.425035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.425105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.425329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.426334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.426334] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.426334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.426334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.426334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.426334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.426334] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c02b558-4061-4814-87d2-971e99c2bcce is going to be updated. [ 904.450267] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.451740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.451740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.451740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.451740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.451740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c02b558-4061-4814-87d2-971e99c2bcce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.923364] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.327114] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e97df514-272c-47bf-a99a-d9d5458cd9ab in Status: SUCCESS [ 905.327341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.327511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.327732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.327919] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.328058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.328123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.328272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.328351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.328438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.330039] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e97df514-272c-47bf-a99a-d9d5458cd9ab',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.426286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.426523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.426648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.426944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.427130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.427249] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 is going to be updated. [ 905.463288] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.463538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.463655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.463969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.464255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.478857] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: IN_PROGRESS for 2s [ 905.820371] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e24b48ad-1ed5-4566-912b-a63687a8de4d in Status: SUCCESS [ 905.820627] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d deletion is rescheduled due to dependency. [ 905.820746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.840553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97df514-272c-47bf-a99a-d9d5458cd9ab taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.840744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.840841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.841139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.841243] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.841397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.841397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.841595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.841701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.841865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.841978] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97df514-272c-47bf-a99a-d9d5458cd9ab taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.842089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.842089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.842283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.842368] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.842471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.842555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.842721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.842796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.842859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.845530] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e97df514-272c-47bf-a99a-d9d5458cd9ab',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.349452] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e97df514-272c-47bf-a99a-d9d5458cd9ab: rpc.has_security_group_logging(os_id): False [ 906.369991] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.370203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.370203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.370434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.370527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.370813] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.370813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.370970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.371092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.371177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.371539] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.371539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.371539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.371690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.371718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.371905] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.371996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.372127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.372318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.372389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.372563] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e97df514-272c-47bf-a99a-d9d5458cd9ab is going to be created. [ 906.449539] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.449687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.449754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.450997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.450997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.465964] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e97df514-272c-47bf-a99a-d9d5458cd9ab in Status: IN_PROGRESS for 2s [ 906.789988] env[65678]: INFO networking_nsxv3.common.synchronization [req-4eed2f85-fa2d-40c6-9974-a4ce365b246f req-89c85751-f311-49fd-8519-6a9bdec63879 tempest-MigrationsAdminTest-513313397 tempest-MigrationsAdminTest-513313397-project-member] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 906.790157] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGHEST for action security_group_members [ 906.790466] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.790653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.790758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.791316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.791588] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.791820] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.791977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.792287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.792469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.792648] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.983641] env[65678]: INFO networking_nsxv3.common.synchronization [None req-c778b297-b677-4d53-bdf5-ce1e74d32c87 None None] Enqueued Resource ID: 292984a7-a34c-498a-aebc-20b6b2bba18f with Priority: HIGHEST for action port [ 906.985118] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 292984a7-a34c-498a-aebc-20b6b2bba18f with Priority: HIGHEST for action port [ 906.985839] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-292984a7-a34c-498a-aebc-20b6b2bba18f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.987431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-292984a7-a34c-498a-aebc-20b6b2bba18f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.987578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-292984a7-a34c-498a-aebc-20b6b2bba18f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.987908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-292984a7-a34c-498a-aebc-20b6b2bba18f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.988046] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('292984a7-a34c-498a-aebc-20b6b2bba18f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.296607] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.296607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.296607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.296800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.296800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.297074] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.297202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.297241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.297415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.297568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.297614] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b is going to be updated. [ 907.334732] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.334968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.334968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.335339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.347650] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: IN_PROGRESS for 2s [ 907.493367] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 292984a7-a34c-498a-aebc-20b6b2bba18f [ 907.493699] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.493776] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.493909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.494525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.494525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.494525] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:292984a7-a34c-498a-aebc-20b6b2bba18f already deleted. [ 907.494525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-292984a7-a34c-498a-aebc-20b6b2bba18f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.499800] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: SUCCESS [ 907.500035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.500208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.500433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.500618] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.500746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.500808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.500983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.501073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.501161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.501262] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.670077] env[65678]: INFO networking_nsxv3.common.synchronization [None req-05f495dd-9f5b-48cd-8170-5f01f5d09523 tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: dcf416e5-e522-4a52-9743-a71090c4b18d with Priority: HIGHEST for action security_group_rules [ 907.670350] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf416e5-e522-4a52-9743-a71090c4b18d with Priority: HIGHEST for action security_group_rules [ 907.671072] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcf416e5-e522-4a52-9743-a71090c4b18d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.671072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcf416e5-e522-4a52-9743-a71090c4b18d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.671072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcf416e5-e522-4a52-9743-a71090c4b18d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.671367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcf416e5-e522-4a52-9743-a71090c4b18d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.671434] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcf416e5-e522-4a52-9743-a71090c4b18d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.790696] env[65678]: INFO networking_nsxv3.common.synchronization [None req-b77bfa0d-9042-43f4-910f-d2f4689a30e6 tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: dcf416e5-e522-4a52-9743-a71090c4b18d with Priority: HIGHEST for action security_group_rules [ 907.791095] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcf416e5-e522-4a52-9743-a71090c4b18d with Priority: HIGHEST for action security_group_rules [ 907.791506] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcf416e5-e522-4a52-9743-a71090c4b18d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.791733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcf416e5-e522-4a52-9743-a71090c4b18d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.003624] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.196759] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.196952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.197041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.197272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.197366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.197493] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcf416e5-e522-4a52-9743-a71090c4b18d already deleted. [ 908.197584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcf416e5-e522-4a52-9743-a71090c4b18d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.197738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcf416e5-e522-4a52-9743-a71090c4b18d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.197932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcf416e5-e522-4a52-9743-a71090c4b18d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.201017] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcf416e5-e522-4a52-9743-a71090c4b18d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.484339] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e97df514-272c-47bf-a99a-d9d5458cd9ab in Status: SUCCESS [ 908.484339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.506321] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ad6310b-73d1-441e-897d-b412b1e437a2: rpc.has_security_group_logging(os_id): False [ 908.531889] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.532132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.532216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.532586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.562875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.563104] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.563244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.563324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.563517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.563619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.563714] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 is going to be updated. [ 908.639811] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.640072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.640180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.640465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.640694] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.659214] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: IN_PROGRESS for 2s [ 908.725186] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.725996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.725996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.725996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.725996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.725996] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcf416e5-e522-4a52-9743-a71090c4b18d already deleted. [ 908.725996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcf416e5-e522-4a52-9743-a71090c4b18d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.359253] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b in Status: SUCCESS [ 909.359531] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b deletion is rescheduled due to dependency. [ 909.359704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.656839] env[65678]: INFO networking_nsxv3.common.synchronization [None req-97626be1-c2e0-47a1-82b8-dc3c6e6d0027 None None] Enqueued Resource ID: 6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633 with Priority: HIGHEST for action port [ 909.658210] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633 with Priority: HIGHEST for action port [ 909.658210] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.658210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.658210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.658797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.658954] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.821818] env[65678]: INFO networking_nsxv3.common.synchronization [req-07c900a1-387c-4949-b6cd-3d9cf53d3abf req-fa420d56-ac09-41dc-ad18-f1095557aee1 tempest-ImagesOneServerNegativeTestJSON-281812694 tempest-ImagesOneServerNegativeTestJSON-281812694-project-member] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 909.822395] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 909.822771] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.822839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.822944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.823135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.823300] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.823411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.823473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.823625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.823707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.823797] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.065600] env[65678]: INFO networking_nsxv3.common.synchronization [req-ddd66560-06f1-4f6b-9a1c-eaa5d0115139 req-7b886b01-53ea-4895-a3e5-9e4daa43766c tempest-ServersWithSpecificFlavorTestJSON-1798572525 tempest-ServersWithSpecificFlavorTestJSON-1798572525-project-member] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 910.069553] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGHEST for action security_group_members [ 910.069553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.069553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.069553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.069553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.069553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.069553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.069553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.069553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.069553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.069553] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.163157] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633 [ 910.163544] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.163771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.163829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.164210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.164344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.164482] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633 already deleted. [ 910.164599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6246b871-e3ff-4a2c-bdd6-2ccd1e2a5633" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.329923] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.329923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.330122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.330289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.330384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.330587] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.330691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.330755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.330959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.331047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.331111] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be updated. [ 910.361128] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-408 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.361313] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.361507] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.361707] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.362101] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.362245] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.362447] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.362834] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.362834] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.363597] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.363597] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.363597] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.363597] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.363597] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.363857] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.364036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.365744] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.366122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.366122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.366270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.366369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.378179] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 910.387349] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.387619] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.387703] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.387928] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-408" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.388443] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-0f593d83-2cad-431c-a6be-c56809ce59ae taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.389252] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-0f593d83-2cad-431c-a6be-c56809ce59ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.389252] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-0f593d83-2cad-431c-a6be-c56809ce59ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.389252] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-0f593d83-2cad-431c-a6be-c56809ce59ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.389252] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f593d83-2cad-431c-a6be-c56809ce59ae',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.578269] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.578269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.578269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.578269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.578269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.578269] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.578269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.578269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.578269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.578269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.579290] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d6ddb-7487-401b-862b-e16865015657 is going to be updated. [ 910.615878] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.615878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.615878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.615878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.615878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.621410] env[65678]: INFO networking_nsxv3.common.synchronization [req-f28f5a60-190e-4c34-baa7-a1ebccec6647 req-9fce7534-4659-4c35-aeaf-8af03838fd07 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_members [ 910.622532] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 with Priority: HIGHEST for action security_group_members [ 910.623066] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bcfce19-b3dc-46b9-a272-88acde866ff3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.623471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.625571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.625571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.625571] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.625571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.625571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.625571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.625571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.625571] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bcfce19-b3dc-46b9-a272-88acde866ff3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.627722] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: IN_PROGRESS for 2s [ 910.681019] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: SUCCESS [ 910.682571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.895568] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.895667] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.896327] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.896488] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.896658] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.896844] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 0f593d83-2cad-431c-a6be-c56809ce59ae not found, creating... [ 910.897378] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.897588] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.897718] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.897941] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.898084] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.898382] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.898537] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.898662] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.898891] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.899213] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.899820] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 0f593d83-2cad-431c-a6be-c56809ce59ae is going to be created. [ 910.930403] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.931671] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.931671] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.931671] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.932611] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.932865] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-0f593d83-2cad-431c-a6be-c56809ce59ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.128035] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.128744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.128871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.129525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.129525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.129742] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.129946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.130082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.130379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.130535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.130725] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 is going to be updated. [ 911.167322] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.167322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.167322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.167322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.167322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.181395] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 in Status: IN_PROGRESS for 2s [ 911.657944] env[65678]: INFO networking_nsxv3.common.synchronization [req-07c900a1-387c-4949-b6cd-3d9cf53d3abf req-66b1a9cf-1f7a-421d-979c-533fd2f88df6 service nova] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_rules [ 911.658142] env[65678]: INFO networking_nsxv3.common.synchronization [req-07c900a1-387c-4949-b6cd-3d9cf53d3abf req-66b1a9cf-1f7a-421d-979c-533fd2f88df6 service nova] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 911.658294] env[65678]: INFO networking_nsxv3.common.synchronization [req-07c900a1-387c-4949-b6cd-3d9cf53d3abf req-66b1a9cf-1f7a-421d-979c-533fd2f88df6 service nova] Enqueued Resource ID: 0f593d83-2cad-431c-a6be-c56809ce59ae with Priority: HIGHEST for action port [ 911.658944] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_rules [ 911.659419] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 911.659630] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f593d83-2cad-431c-a6be-c56809ce59ae with Priority: HIGHEST for action port [ 911.660143] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.660272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.660340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.660582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.660691] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.661653] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.661716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.662619] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f593d83-2cad-431c-a6be-c56809ce59ae taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.662766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f593d83-2cad-431c-a6be-c56809ce59ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.662865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f593d83-2cad-431c-a6be-c56809ce59ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.663164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f593d83-2cad-431c-a6be-c56809ce59ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.663253] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f593d83-2cad-431c-a6be-c56809ce59ae',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.849869] env[65678]: INFO networking_nsxv3.common.synchronization [req-e22b1828-cc7e-4e58-b00a-2a0b3544af17 req-591b44d7-7063-439e-9334-e3c1deab08b7 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 911.850491] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 911.851121] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.851431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.851538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.852269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.852590] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.852788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.852881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.853306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.853446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.853933] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.165531] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.165531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.165749] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f593d83-2cad-431c-a6be-c56809ce59ae with status ACTIVE [ 912.166071] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.166071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.166071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.166419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.166419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.166563] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.166615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.166666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.166872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.166957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.167171] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.167328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.167374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.167507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.167576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.167704] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f593d83-2cad-431c-a6be-c56809ce59ae is going to be updated. [ 912.193493] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.193657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.193714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.193928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.194734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.194734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f593d83-2cad-431c-a6be-c56809ce59ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.289097] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.289097] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.289097] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.289097] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.289097] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.289448] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.289448] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.289522] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.289682] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.289917] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.290042] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.290156] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.290264] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.290378] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.290473] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.290603] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.318190] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.318452] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.318614] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.318849] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.319165] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-ca57037e-9918-42fa-8cd2-a1d72038bd0e taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.319349] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-ca57037e-9918-42fa-8cd2-a1d72038bd0e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.319476] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-ca57037e-9918-42fa-8cd2-a1d72038bd0e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.319880] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-ca57037e-9918-42fa-8cd2-a1d72038bd0e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.319980] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca57037e-9918-42fa-8cd2-a1d72038bd0e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.357131] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.357591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.357591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.357715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.358427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.358427] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.358427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.358427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.358427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.358427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.358427] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be deleted. [ 912.393173] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 912.393173] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 deletion is rescheduled due to dependency. [ 912.393173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.393173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.393173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.393173] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.393173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.393173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.393173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.393173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.393173] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.395486] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.396301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.396482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.396753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.396928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.397133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.644322] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 433d6ddb-7487-401b-862b-e16865015657 in Status: SUCCESS [ 912.644322] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 433d6ddb-7487-401b-862b-e16865015657 deletion is rescheduled due to dependency. [ 912.644678] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.822631] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.822850] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.822970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.823571] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.823571] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.825051] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port ca57037e-9918-42fa-8cd2-a1d72038bd0e not found, creating... [ 912.825051] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.825051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.825051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.825051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.825051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.825528] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.826037] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.826306] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.826539] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.826675] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.826828] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: ca57037e-9918-42fa-8cd2-a1d72038bd0e is going to be created. [ 912.848502] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.848895] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.849073] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.849483] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.849834] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.850279] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-ca57037e-9918-42fa-8cd2-a1d72038bd0e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.894640] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.193759] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 in Status: SUCCESS [ 913.193962] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bcfce19-b3dc-46b9-a272-88acde866ff3 deletion is rescheduled due to dependency. [ 913.194099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bcfce19-b3dc-46b9-a272-88acde866ff3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.398562] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.573766] env[65678]: INFO networking_nsxv3.common.synchronization [req-e22b1828-cc7e-4e58-b00a-2a0b3544af17 req-4767aa6b-e7fe-4a8a-9e9a-ebefd7aab442 service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 913.573962] env[65678]: INFO networking_nsxv3.common.synchronization [req-e22b1828-cc7e-4e58-b00a-2a0b3544af17 req-4767aa6b-e7fe-4a8a-9e9a-ebefd7aab442 service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 913.574158] env[65678]: INFO networking_nsxv3.common.synchronization [req-e22b1828-cc7e-4e58-b00a-2a0b3544af17 req-4767aa6b-e7fe-4a8a-9e9a-ebefd7aab442 service nova] Enqueued Resource ID: ca57037e-9918-42fa-8cd2-a1d72038bd0e with Priority: HIGHEST for action port [ 913.574912] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 913.575020] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 913.575064] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca57037e-9918-42fa-8cd2-a1d72038bd0e with Priority: HIGHEST for action port [ 913.575408] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.575560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.575632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.575862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.575948] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.577132] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.577717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.577799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.578029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.578198] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.578301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.578386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.578556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.578642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.578813] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.579583] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca57037e-9918-42fa-8cd2-a1d72038bd0e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.579707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca57037e-9918-42fa-8cd2-a1d72038bd0e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.579803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca57037e-9918-42fa-8cd2-a1d72038bd0e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.580031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca57037e-9918-42fa-8cd2-a1d72038bd0e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.580166] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca57037e-9918-42fa-8cd2-a1d72038bd0e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.900657] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.901109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.901109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.901247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.901349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.901456] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be updated. [ 913.968660] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.968660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.968942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.969083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.969374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.997424] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 914.083083] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.083311] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.083419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.083658] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca57037e-9918-42fa-8cd2-a1d72038bd0e with status ACTIVE [ 914.083826] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.083926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.084061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.084237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.084322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.084489] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.084579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.084632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.085983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.085983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.085983] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.085983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.085983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.085983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.085983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.085983] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca57037e-9918-42fa-8cd2-a1d72038bd0e is going to be updated. [ 914.111501] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.111721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.111721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.112020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.112229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.112524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca57037e-9918-42fa-8cd2-a1d72038bd0e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.588060] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.090924] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.091384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.091384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.091384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.091601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.091601] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be created. [ 915.120509] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.120509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.120509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.120759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.120950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.137193] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: UNINITIALIZED for 2s [ 915.403212] env[65678]: INFO networking_nsxv3.common.synchronization [req-a2a75723-9f1a-42dd-bf61-3320adbcd67b req-83fa669a-d8c4-4274-ae49-2337e96720e5 tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 915.404176] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 915.404904] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.405072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.405146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.405395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.405537] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.405638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.405700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.405848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.405934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.406302] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.758866] env[65678]: INFO networking_nsxv3.common.synchronization [req-d6532870-2da4-4129-b101-f960068147ff req-c8a3727f-cfbd-4819-ae99-55f6f6ddbd1c tempest-ServersAdminNegativeTestJSON-1032160483 tempest-ServersAdminNegativeTestJSON-1032160483-project-member] Enqueued Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 915.760043] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGHEST for action security_group_members [ 915.760544] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-2164111b-0060-40e2-86c3-edfc4931cb24 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.760803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.760975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.761303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.762939] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.763130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.763220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.763462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.763566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.763685] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2164111b-0060-40e2-86c3-edfc4931cb24',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.909272] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.909694] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.909807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.910150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.938360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.938750] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.938750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.938939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.940188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.940188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.940188] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 915.981323] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.981477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.981569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.981755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.981905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.996286] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 916.010327] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 916.010327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.010775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.010775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.010946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.011038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.011220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.011687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.011687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.011687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.012196] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.269037] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.269420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.269420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.269420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.269510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.269685] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.269800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.269834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.269998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.270140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.270183] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2164111b-0060-40e2-86c3-edfc4931cb24 is going to be updated. [ 916.330512] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.330659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.330738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.330961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.331492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.351308] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: IN_PROGRESS for 2s [ 916.516855] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.517740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.517740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.517740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.517740] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.517888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.517888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.518066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.518129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.518228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.518441] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.518549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.518610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.518771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.518916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.519018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.519136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.519249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.519370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.519473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.519821] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.022861] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b634fd1e-f1ec-4189-ac44-9f8fa9578204: rpc.has_security_group_logging(os_id): False [ 917.045221] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.045221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.045221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.045221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.045221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.045221] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.045221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.045221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.045221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.045549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.045549] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.045549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.045655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.046674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.046674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.046674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.046674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.046674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.046674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.046674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.046970] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be updated. [ 917.116920] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.117194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.117308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.118035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.118035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.137597] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 917.161375] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 917.161691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.161890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.162223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.162553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.162665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.162750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.162977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.163376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.163376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.163488] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.665599] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.665940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.665940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.666042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.666323] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.666323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.666445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.667210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.667210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.667210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.667210] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.667210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.667210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.667210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.667519] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.667519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.667519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.667681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.667805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.668137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.668284] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.751082] env[65678]: INFO networking_nsxv3.common.synchronization [req-fbce69f3-ca2f-4866-af46-0200d5a001a3 req-63de646c-d8b9-41e7-a1e6-b683cf1c6398 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 917.751628] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 917.752020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.752150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.752217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.752467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.752621] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.752724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.752766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.753783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.753783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.754495] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.007866] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 918.008081] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d deletion is rescheduled due to dependency. [ 918.008215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.167536] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.167808] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.168463] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.168463] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.169640] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.169640] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.169640] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.170141] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.170141] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.170387] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.170561] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.170717] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.170880] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.171062] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.171249] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.171513] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.173171] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02e933d1-ac0d-4baa-9da0-e149762ce926: rpc.has_security_group_logging(os_id): False [ 918.191435] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.191578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.195032] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.195032] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.195032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.195032] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.195750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.195750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.195750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.195750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.195750] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be created. [ 918.195972] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.196191] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 918.196370] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.196567] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.196870] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-83095d6d-2fa5-4d6e-ae92-9f05c7313818 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.197081] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-83095d6d-2fa5-4d6e-ae92-9f05c7313818" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.197242] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-83095d6d-2fa5-4d6e-ae92-9f05c7313818" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.197556] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-83095d6d-2fa5-4d6e-ae92-9f05c7313818" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.197761] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83095d6d-2fa5-4d6e-ae92-9f05c7313818',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.259040] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.259040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.259040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.259040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.259040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.259930] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.260021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.260088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.260256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.260338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.260561] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.260659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.260721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.261535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.261535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.261535] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef already deleted. [ 918.261535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.272948] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 918.363709] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2164111b-0060-40e2-86c3-edfc4931cb24 in Status: SUCCESS [ 918.363863] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2164111b-0060-40e2-86c3-edfc4931cb24 deletion is rescheduled due to dependency. [ 918.363973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2164111b-0060-40e2-86c3-edfc4931cb24" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.700904] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.701282] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.701282] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.701576] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.701729] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.701997] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 83095d6d-2fa5-4d6e-ae92-9f05c7313818 not found, creating... [ 918.702394] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.702502] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.702650] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.702945] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.703135] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.703511] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.703708] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.703853] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.704148] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.704317] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.704559] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 83095d6d-2fa5-4d6e-ae92-9f05c7313818 is going to be created. [ 918.725387] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.725577] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.725701] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.725970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.726223] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.726445] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-83095d6d-2fa5-4d6e-ae92-9f05c7313818" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.155374] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 919.155663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.466027] env[65678]: INFO networking_nsxv3.common.synchronization [req-fbce69f3-ca2f-4866-af46-0200d5a001a3 req-c53924f5-6a33-4a55-ab70-f92b550dedf9 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 919.466027] env[65678]: INFO networking_nsxv3.common.synchronization [req-fbce69f3-ca2f-4866-af46-0200d5a001a3 req-c53924f5-6a33-4a55-ab70-f92b550dedf9 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 919.466027] env[65678]: INFO networking_nsxv3.common.synchronization [req-fbce69f3-ca2f-4866-af46-0200d5a001a3 req-c53924f5-6a33-4a55-ab70-f92b550dedf9 service nova] Enqueued Resource ID: 83095d6d-2fa5-4d6e-ae92-9f05c7313818 with Priority: HIGHEST for action port [ 919.466027] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 919.466027] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 919.466027] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83095d6d-2fa5-4d6e-ae92-9f05c7313818 with Priority: HIGHEST for action port [ 919.466548] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.466548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.466548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.466732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.466732] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.470219] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.470219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.470219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.470219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.470219] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.470219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.470219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.470219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.470219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.470219] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.470219] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-83095d6d-2fa5-4d6e-ae92-9f05c7313818 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.470219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83095d6d-2fa5-4d6e-ae92-9f05c7313818" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.470219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83095d6d-2fa5-4d6e-ae92-9f05c7313818" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.470835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83095d6d-2fa5-4d6e-ae92-9f05c7313818" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.470835] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83095d6d-2fa5-4d6e-ae92-9f05c7313818',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.882384] env[65678]: INFO networking_nsxv3.common.synchronization [None req-5a21b204-62d0-43e0-bead-8b5e14f43d99 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 919.883696] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 919.884154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.884260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.884431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.884562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.884677] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.884830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.884830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.884988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.885855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.885855] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.969149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.969324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.971976] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.973016] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83095d6d-2fa5-4d6e-ae92-9f05c7313818 with status ACTIVE [ 919.976022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.976022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.976022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.976022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.976022] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83095d6d-2fa5-4d6e-ae92-9f05c7313818 is going to be updated. [ 919.999618] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.999618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.999618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.999871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.999902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.000069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83095d6d-2fa5-4d6e-ae92-9f05c7313818" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.286757] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 920.286757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.378139] env[65678]: INFO networking_nsxv3.common.synchronization [req-2d486b3c-175b-4aa6-9c91-0921907038ba req-c9bc6387-d7d9-4cdb-88a5-1003152b022e tempest-InstanceActionsV221TestJSON-1487170191 tempest-InstanceActionsV221TestJSON-1487170191-project-member] Enqueued Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGHEST for action security_group_members [ 920.379023] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGHEST for action security_group_members [ 920.379351] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-009db6c2-7197-4126-8d71-ff2f27ca91b3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.379480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.379550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.379819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.379976] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.380095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.380160] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.380757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.380813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.380902] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('009db6c2-7197-4126-8d71-ff2f27ca91b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.387117] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.477744] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.809272] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.809677] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-759" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.809677] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-759" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.810198] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-759" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.812131] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.812351] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.812478] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.812722] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.812871] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.813135] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.813275] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.813373] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.813484] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.813626] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.813695] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.813825] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.840108] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.840108] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 920.841441] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.841786] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-759" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.842410] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-5cfa5863-86be-4e0a-922a-1e81c399966f taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.842646] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-5cfa5863-86be-4e0a-922a-1e81c399966f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.842813] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-5cfa5863-86be-4e0a-922a-1e81c399966f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.843539] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-5cfa5863-86be-4e0a-922a-1e81c399966f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.844513] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cfa5863-86be-4e0a-922a-1e81c399966f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.884449] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.884709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.884709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.884879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.884961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.885166] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.885885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.886453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.886806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.886888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.887085] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 already deleted. [ 920.887178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.889191] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.981793] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.982432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.982614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.982733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.982821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.983116] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be created. [ 921.014531] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.014697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.014757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.015082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.015741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.026739] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: UNINITIALIZED for 2s [ 921.348289] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.348503] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.348623] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.349892] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.349892] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.349892] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 5cfa5863-86be-4e0a-922a-1e81c399966f not found, creating... [ 921.349892] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.349892] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.349892] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.350699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.350699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.350699] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.350699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.350699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.350932] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.351197] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.351434] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 5cfa5863-86be-4e0a-922a-1e81c399966f is going to be created. [ 921.377561] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.377765] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.378299] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.378299] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.378485] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.378686] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-5cfa5863-86be-4e0a-922a-1e81c399966f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.394458] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.394623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.394696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.394873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.394963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.395079] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 921.449047] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.449047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.449047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.449462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.449462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.461931] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 922.108078] env[65678]: INFO networking_nsxv3.common.synchronization [req-2d486b3c-175b-4aa6-9c91-0921907038ba req-a283abdc-10bb-41fe-9dc3-d2ca56e83be7 service nova] Enqueued Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGHEST for action security_group_rules [ 922.110026] env[65678]: INFO networking_nsxv3.common.synchronization [req-2d486b3c-175b-4aa6-9c91-0921907038ba req-a283abdc-10bb-41fe-9dc3-d2ca56e83be7 service nova] Enqueued Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGHEST for action security_group_members [ 922.110026] env[65678]: INFO networking_nsxv3.common.synchronization [req-2d486b3c-175b-4aa6-9c91-0921907038ba req-a283abdc-10bb-41fe-9dc3-d2ca56e83be7 service nova] Enqueued Resource ID: 5cfa5863-86be-4e0a-922a-1e81c399966f with Priority: HIGHEST for action port [ 922.110026] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGHEST for action security_group_rules [ 922.110026] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGHEST for action security_group_members [ 922.110026] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cfa5863-86be-4e0a-922a-1e81c399966f with Priority: HIGHEST for action port [ 922.111348] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-009db6c2-7197-4126-8d71-ff2f27ca91b3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.111505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.111645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.111863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.111963] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('009db6c2-7197-4126-8d71-ff2f27ca91b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.112923] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-009db6c2-7197-4126-8d71-ff2f27ca91b3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.113105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.113571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.113571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.113571] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.113749] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.113749] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.113869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.113976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.114200] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('009db6c2-7197-4126-8d71-ff2f27ca91b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.114984] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cfa5863-86be-4e0a-922a-1e81c399966f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.115082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cfa5863-86be-4e0a-922a-1e81c399966f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.115116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cfa5863-86be-4e0a-922a-1e81c399966f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.115351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cfa5863-86be-4e0a-922a-1e81c399966f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.115351] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cfa5863-86be-4e0a-922a-1e81c399966f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.616875] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('009db6c2-7197-4126-8d71-ff2f27ca91b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.617913] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-009db6c2-7197-4126-8d71-ff2f27ca91b3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.618043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.618199] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cfa5863-86be-4e0a-922a-1e81c399966f with status ACTIVE [ 922.618357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.618466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.618567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.618724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.618813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.618978] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.619089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.619151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.619305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.619380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.619556] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.619639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.619701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.619835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.619907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.619989] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cfa5863-86be-4e0a-922a-1e81c399966f is going to be updated. [ 922.643907] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.643907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.643907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.643907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.644189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.644189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cfa5863-86be-4e0a-922a-1e81c399966f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.007253] env[65678]: INFO networking_nsxv3.common.synchronization [req-6525e6a3-2481-4c33-84b0-e04537c3236c req-a8479795-1f3f-4dbc-a755-40e65c315a48 tempest-ServersTestManualDisk-33820034 tempest-ServersTestManualDisk-33820034-project-member] Enqueued Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_members [ 923.007889] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_members [ 923.008218] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e8fca5-1dcf-494d-a489-044a26543bc2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.008345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.008423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.008698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.009052] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.009416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.009416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.009416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.009523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.009606] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.037066] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 923.037066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.037397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.037604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.038476] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.038476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.038476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.038476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.038476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.038476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.038476] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.123513] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('009db6c2-7197-4126-8d71-ff2f27ca91b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.307766] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.308058] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.308214] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.308533] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.308854] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.309055] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.309200] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.309482] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.309671] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.309932] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.310096] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.310233] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.310378] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.310505] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.310649] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.310821] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.330687] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.330900] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.331129] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.331280] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.331619] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-62bbe61b-3598-494d-b59b-7a23dd5c725e taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.331816] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-62bbe61b-3598-494d-b59b-7a23dd5c725e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.331944] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-62bbe61b-3598-494d-b59b-7a23dd5c725e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.332328] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-62bbe61b-3598-494d-b59b-7a23dd5c725e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.332479] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62bbe61b-3598-494d-b59b-7a23dd5c725e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.358914] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-672 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.359137] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-672" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.359280] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-672" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.359644] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-672" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.359940] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.360189] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.360352] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.360674] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.360848] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.361095] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.361209] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.361320] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.361511] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.361645] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.361752] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.361911] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.382429] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.382672] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.382944] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.383258] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-672" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.383617] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-941f6d08-0283-41d5-81b7-20f521dc4146 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.383840] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-941f6d08-0283-41d5-81b7-20f521dc4146" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.384041] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-941f6d08-0283-41d5-81b7-20f521dc4146" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.384597] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-941f6d08-0283-41d5-81b7-20f521dc4146" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.384750] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('941f6d08-0283-41d5-81b7-20f521dc4146',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.472983] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 923.473377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.511832] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.512025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.512092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.512341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.512435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.512633] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.512925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.512925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.512925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.513134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.513134] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 already deleted. [ 923.513200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.540676] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.540855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.540899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.541099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.541259] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.541360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.541475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.541603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.541686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.541771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.541922] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.542024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.542087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.542231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.542370] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.542462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.542522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.542658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.542731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.542811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.542899] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.625945] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.626200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.626318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.626637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.626781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.626922] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 is going to be created. [ 923.651945] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.651945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.651945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.652229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.652318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.664305] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 in Status: UNINITIALIZED for 2s [ 923.834582] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.834830] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.834917] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.835368] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.835449] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.835573] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 62bbe61b-3598-494d-b59b-7a23dd5c725e not found, creating... [ 923.835829] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.835985] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.836126] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.836346] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.836484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.836776] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.836923] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.837051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.837264] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.837403] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.837530] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 62bbe61b-3598-494d-b59b-7a23dd5c725e is going to be created. [ 923.875091] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.875452] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.875621] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.875921] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.876176] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.876407] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-62bbe61b-3598-494d-b59b-7a23dd5c725e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.887988] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.888292] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.888371] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.888600] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.888749] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.888906] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 941f6d08-0283-41d5-81b7-20f521dc4146 not found, creating... [ 923.889189] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.889355] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.889472] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.889688] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.889833] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.890120] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.890276] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.890414] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.890599] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.890732] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.890869] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 941f6d08-0283-41d5-81b7-20f521dc4146 is going to be created. [ 923.941318] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.941511] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.941640] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.941925] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.942176] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.942407] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-941f6d08-0283-41d5-81b7-20f521dc4146" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.045553] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79cab93f-aae5-467c-88f3-35382c30a4ef: rpc.has_security_group_logging(os_id): False [ 924.066996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.067274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.067396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.067708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.067862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.068215] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.068381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.068484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.068734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.068859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.069159] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.069337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.069438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.069662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.069786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.070092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.070270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.070361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.070589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.070717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.070854] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be created. [ 924.158232] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.158617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.158617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.158957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.159216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.173803] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 924.626305] env[65678]: INFO networking_nsxv3.common.synchronization [req-00419347-bda1-4c9e-9659-267c698bbef4 req-3139bd6f-bb86-4948-bf78-0abd1d600efb service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 924.626305] env[65678]: INFO networking_nsxv3.common.synchronization [req-00419347-bda1-4c9e-9659-267c698bbef4 req-3139bd6f-bb86-4948-bf78-0abd1d600efb service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 924.626305] env[65678]: INFO networking_nsxv3.common.synchronization [req-00419347-bda1-4c9e-9659-267c698bbef4 req-3139bd6f-bb86-4948-bf78-0abd1d600efb service nova] Enqueued Resource ID: 62bbe61b-3598-494d-b59b-7a23dd5c725e with Priority: HIGHEST for action port [ 924.626305] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 924.626305] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 924.626305] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62bbe61b-3598-494d-b59b-7a23dd5c725e with Priority: HIGHEST for action port [ 924.626763] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.627072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.627281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.627620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.627906] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.628994] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.629273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.629455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.629737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.630051] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.630257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.630513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.630778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.631076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.631300] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.632349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-62bbe61b-3598-494d-b59b-7a23dd5c725e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.637384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62bbe61b-3598-494d-b59b-7a23dd5c725e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.637384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62bbe61b-3598-494d-b59b-7a23dd5c725e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.637384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62bbe61b-3598-494d-b59b-7a23dd5c725e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.637384] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62bbe61b-3598-494d-b59b-7a23dd5c725e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.656022] env[65678]: INFO networking_nsxv3.common.synchronization [req-6525e6a3-2481-4c33-84b0-e04537c3236c req-1b340800-88bc-4e46-817f-9f0897e0b4bc service nova] Enqueued Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_rules [ 924.656022] env[65678]: INFO networking_nsxv3.common.synchronization [req-6525e6a3-2481-4c33-84b0-e04537c3236c req-1b340800-88bc-4e46-817f-9f0897e0b4bc service nova] Enqueued Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_members [ 924.656308] env[65678]: INFO networking_nsxv3.common.synchronization [req-6525e6a3-2481-4c33-84b0-e04537c3236c req-1b340800-88bc-4e46-817f-9f0897e0b4bc service nova] Enqueued Resource ID: 941f6d08-0283-41d5-81b7-20f521dc4146 with Priority: HIGHEST for action port [ 924.656620] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_rules [ 924.656727] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_members [ 924.656825] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 941f6d08-0283-41d5-81b7-20f521dc4146 with Priority: HIGHEST for action port [ 924.657207] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92e8fca5-1dcf-494d-a489-044a26543bc2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.657340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.657407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.657671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.657763] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.659056] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e8fca5-1dcf-494d-a489-044a26543bc2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.659190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.659297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.659487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.659666] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.659734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.662246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.662246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.662246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.662246] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.662246] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-941f6d08-0283-41d5-81b7-20f521dc4146 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.662246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-941f6d08-0283-41d5-81b7-20f521dc4146" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.662246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-941f6d08-0283-41d5-81b7-20f521dc4146" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.662246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-941f6d08-0283-41d5-81b7-20f521dc4146" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.662246] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('941f6d08-0283-41d5-81b7-20f521dc4146',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.038088] env[65678]: INFO networking_nsxv3.common.synchronization [req-098287d9-60aa-4ed9-915b-cf04d0ebb932 req-4a96162d-80ec-45dc-81c3-a36fa0dee037 tempest-ImagesOneServerNegativeTestJSON-281812694 tempest-ImagesOneServerNegativeTestJSON-281812694-project-member] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 925.038703] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGHEST for action security_group_members [ 925.039458] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b634fd1e-f1ec-4189-ac44-9f8fa9578204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.039627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.040742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.041103] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.042322] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.042322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.042322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.042322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.042322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.042322] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b634fd1e-f1ec-4189-ac44-9f8fa9578204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.139290] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.139462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.139596] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.140511] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62bbe61b-3598-494d-b59b-7a23dd5c725e with status ACTIVE [ 925.140709] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.140823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.140887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.141152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.141243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.141415] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.141511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.141570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.141737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.141813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.141991] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.142600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.142704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.142885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.143027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.143206] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62bbe61b-3598-494d-b59b-7a23dd5c725e is going to be updated. [ 925.163365] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.164562] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e8fca5-1dcf-494d-a489-044a26543bc2 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.164679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.164842] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 941f6d08-0283-41d5-81b7-20f521dc4146 with status ACTIVE [ 925.164995] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.165114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.165181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.165383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.165473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.165638] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.165733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.165795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.165946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.166035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.166218] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.166338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.166376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.166501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.166571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.166652] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 941f6d08-0283-41d5-81b7-20f521dc4146 is going to be updated. [ 925.170266] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.170873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.170951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.171234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.171367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.171525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62bbe61b-3598-494d-b59b-7a23dd5c725e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.196277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.196471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.196471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.196719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.197048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.197284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-941f6d08-0283-41d5-81b7-20f521dc4146" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.546146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.546303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.546385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.546586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.546677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.546868] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.546963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.547045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.547194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.547337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.547370] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 is going to be updated. [ 925.581916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.581916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.581916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.582220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.582304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.593274] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: IN_PROGRESS for 2s [ 925.645545] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.672794] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.677037] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 in Status: SUCCESS [ 925.677266] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.677842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.678200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.678200] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.678333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.678465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.678518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.678587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.678669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.678766] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('009db6c2-7197-4126-8d71-ff2f27ca91b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.147748] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.148050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.148160] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.148929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.148929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.148929] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 926.175835] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.176603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.176603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.176603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.176774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.176900] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 is going to be created. [ 926.180372] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-009db6c2-7197-4126-8d71-ff2f27ca91b3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.180561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.180639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.180885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.181557] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.181765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.181885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.182150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.182323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.182490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.182979] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-009db6c2-7197-4126-8d71-ff2f27ca91b3 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.183130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.183219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.183500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.183803] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.184413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.184573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.184896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.185055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.185232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.185365] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('009db6c2-7197-4126-8d71-ff2f27ca91b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.188287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.188510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.188609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.188842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.189041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.192585] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 926.192911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.209428] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 926.226328] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.226574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.226658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.226885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.227057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.246968] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 in Status: UNINITIALIZED for 2s [ 926.693189] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 009db6c2-7197-4126-8d71-ff2f27ca91b3: rpc.has_security_group_logging(os_id): False [ 926.711666] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.711874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.712559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.712559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.712559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.712559] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.712743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.712743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.712884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.713302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.713302] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.713302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.713440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.713488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.713565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.713759] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.713886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.714100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.714265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.714343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.714430] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 is going to be created. [ 926.774807] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.775163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.775282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.775675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.775923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.789750] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 in Status: IN_PROGRESS for 2s [ 927.606205] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 in Status: SUCCESS [ 927.606605] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 deletion is rescheduled due to dependency. [ 927.606605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b634fd1e-f1ec-4189-ac44-9f8fa9578204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.224177] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 928.224500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.224817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.225141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.225481] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.225702] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.225845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.226137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.226393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.226535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.226711] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.258342] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 in Status: SUCCESS [ 928.258708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.259412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.259767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.260064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.260239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.260311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.260720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.260720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.260845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.261091] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.730365] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.730706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.730706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.731295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.731594] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.731763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.731862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.732314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.732495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.733458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.733793] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.733998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.734153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.734471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.734850] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.735054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.735184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.735490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.735643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.735795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.735956] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.764072] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.807232] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 in Status: SUCCESS [ 928.807232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.238733] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02e933d1-ac0d-4baa-9da0-e149762ce926: rpc.has_security_group_logging(os_id): False [ 929.263038] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.263038] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.263038] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.263038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.263639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.263639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.263639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.263639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.263639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.263639] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 929.266736] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92e8fca5-1dcf-494d-a489-044a26543bc2: rpc.has_security_group_logging(os_id): False [ 929.288273] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.288497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.289153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.289153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.289153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.289353] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.289586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.289586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.289704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.289803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.289850] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 is going to be created. [ 929.335813] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.337073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.337168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.337395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.337554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.355326] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 929.359604] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.359869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.360460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.360460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.360655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.368035] env[65678]: INFO networking_nsxv3.common.synchronization [None req-2f91fb47-56eb-4be3-8e94-ec39fd3bdd87 None None] Enqueued Resource ID: 1c74b5cf-26f8-43b9-9418-13a72c19c5ad with Priority: HIGHEST for action port [ 929.368035] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c74b5cf-26f8-43b9-9418-13a72c19c5ad with Priority: HIGHEST for action port [ 929.368035] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c74b5cf-26f8-43b9-9418-13a72c19c5ad taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.372024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c74b5cf-26f8-43b9-9418-13a72c19c5ad" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.372024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c74b5cf-26f8-43b9-9418-13a72c19c5ad" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.372024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c74b5cf-26f8-43b9-9418-13a72c19c5ad" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.372024] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c74b5cf-26f8-43b9-9418-13a72c19c5ad',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.381095] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 in Status: IN_PROGRESS for 2s [ 929.872979] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c74b5cf-26f8-43b9-9418-13a72c19c5ad [ 929.873802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.873802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.873802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.874098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.874276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.874472] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c74b5cf-26f8-43b9-9418-13a72c19c5ad already deleted. [ 929.874607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c74b5cf-26f8-43b9-9418-13a72c19c5ad" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.380295] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 931.380779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.394083] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 in Status: SUCCESS [ 931.394334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.460138] env[65678]: INFO networking_nsxv3.common.synchronization [req-0b6b575f-a54b-40d2-a652-7c5af6bc31ac req-9f7fc152-594d-46b1-a192-c341bb1c6207 tempest-ServerTagsTestJSON-978582925 tempest-ServerTagsTestJSON-978582925-project-member] Enqueued Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGHEST for action security_group_members [ 931.460843] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGHEST for action security_group_members [ 931.461372] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e97df514-272c-47bf-a99a-d9d5458cd9ab taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.462259] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.462380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.462763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.462956] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.463158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.463261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.463471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.463565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.464557] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e97df514-272c-47bf-a99a-d9d5458cd9ab',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.967349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.967526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.967880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.968115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.970018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.970018] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.970018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.970018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.970018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.970018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.970018] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e97df514-272c-47bf-a99a-d9d5458cd9ab is going to be updated. [ 932.007478] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.011023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.011023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.011023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.011023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.020568] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e97df514-272c-47bf-a99a-d9d5458cd9ab in Status: IN_PROGRESS for 2s [ 932.295275] env[65678]: INFO networking_nsxv3.common.synchronization [None req-4a229c07-2345-4fa6-ad81-50bd9e51e9d6 None None] Enqueued Resource ID: c03f8cd3-d737-4553-84bf-ead168a5b3fe with Priority: HIGHEST for action port [ 932.296742] env[65678]: INFO networking_nsxv3.common.synchronization [None req-53f8a1bd-e5bd-4b9f-978e-fce23c042f5f None None] Enqueued Resource ID: e2f1b61d-c4c2-45b3-905a-b655b87f00d4 with Priority: HIGHEST for action port [ 932.297549] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c03f8cd3-d737-4553-84bf-ead168a5b3fe with Priority: HIGHEST for action port [ 932.298508] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2f1b61d-c4c2-45b3-905a-b655b87f00d4 with Priority: HIGHEST for action port [ 932.299968] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c03f8cd3-d737-4553-84bf-ead168a5b3fe taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.299968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c03f8cd3-d737-4553-84bf-ead168a5b3fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.299968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c03f8cd3-d737-4553-84bf-ead168a5b3fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.299968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c03f8cd3-d737-4553-84bf-ead168a5b3fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.300385] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c03f8cd3-d737-4553-84bf-ead168a5b3fe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.301084] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2f1b61d-c4c2-45b3-905a-b655b87f00d4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.301084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2f1b61d-c4c2-45b3-905a-b655b87f00d4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.301251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2f1b61d-c4c2-45b3-905a-b655b87f00d4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.301612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2f1b61d-c4c2-45b3-905a-b655b87f00d4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.301612] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2f1b61d-c4c2-45b3-905a-b655b87f00d4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.804656] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c03f8cd3-d737-4553-84bf-ead168a5b3fe [ 932.805077] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.805077] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.805223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.805314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.805455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.805531] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c03f8cd3-d737-4553-84bf-ead168a5b3fe already deleted. [ 932.805583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c03f8cd3-d737-4553-84bf-ead168a5b3fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.805867] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2f1b61d-c4c2-45b3-905a-b655b87f00d4 [ 932.806440] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.806440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.806440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.806440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.806440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.806825] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2f1b61d-c4c2-45b3-905a-b655b87f00d4 already deleted. [ 932.806825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2f1b61d-c4c2-45b3-905a-b655b87f00d4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.034784] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e97df514-272c-47bf-a99a-d9d5458cd9ab in Status: SUCCESS [ 934.035202] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e97df514-272c-47bf-a99a-d9d5458cd9ab deletion is rescheduled due to dependency. [ 934.035729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.189418] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e5b48c3-697e-4d97-b69f-490dfab919eb req-90e67787-51bb-4b2f-b75f-ac8cdbf08569 tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 934.191835] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 934.191835] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.191835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.191835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.191835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.191835] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.191835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.191835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.193291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.193291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.193432] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.606600] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.606600] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.606600] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.606819] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.607084] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.608040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.608040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.608040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.608040] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.608040] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.612981] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.612981] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.612981] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.612981] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.612981] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.612981] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.634300] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.634903] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 934.635169] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.635404] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.635821] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-c5af7078-c088-43f5-86e4-32c3096195b2 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.636048] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-c5af7078-c088-43f5-86e4-32c3096195b2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.636180] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-c5af7078-c088-43f5-86e4-32c3096195b2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.641768] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-c5af7078-c088-43f5-86e4-32c3096195b2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.641768] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5af7078-c088-43f5-86e4-32c3096195b2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.697246] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.697442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.697511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.697716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.697812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.698029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.698131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.698190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.698387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.698474] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.698591] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 934.733504] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.733699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.733764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.734144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.734929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.746895] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 934.876693] env[65678]: INFO networking_nsxv3.common.synchronization [None req-4c3f1939-103a-438a-912a-70d85c025a26 None None] Enqueued Resource ID: 3a76994b-4d44-49ff-9b59-a2a1932389f1 with Priority: HIGHEST for action port [ 934.879711] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a76994b-4d44-49ff-9b59-a2a1932389f1 with Priority: HIGHEST for action port [ 934.880131] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a76994b-4d44-49ff-9b59-a2a1932389f1 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.880268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a76994b-4d44-49ff-9b59-a2a1932389f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.880334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a76994b-4d44-49ff-9b59-a2a1932389f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.880604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a76994b-4d44-49ff-9b59-a2a1932389f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.880687] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a76994b-4d44-49ff-9b59-a2a1932389f1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.144150] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.144537] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.144710] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.145179] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.145469] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.145549] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port c5af7078-c088-43f5-86e4-32c3096195b2 not found, creating... [ 935.145765] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.145924] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.146063] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.146457] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.146546] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.146768] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.146920] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.147049] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.147269] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.147494] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.147566] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: c5af7078-c088-43f5-86e4-32c3096195b2 is going to be created. [ 935.170239] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.170582] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.170673] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.170867] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.171149] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.171381] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-c5af7078-c088-43f5-86e4-32c3096195b2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.382805] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a76994b-4d44-49ff-9b59-a2a1932389f1 [ 935.383114] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.383219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.383295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.383524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.383615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.383713] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a76994b-4d44-49ff-9b59-a2a1932389f1 already deleted. [ 935.383796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a76994b-4d44-49ff-9b59-a2a1932389f1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.435680] env[65678]: INFO networking_nsxv3.common.synchronization [None req-b7322fb3-5ece-4e1a-810f-866fa66b752f None None] Enqueued Resource ID: 5fd82ec2-8083-4d32-8acd-ca7b9c48ea37 with Priority: HIGHEST for action port [ 935.436384] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fd82ec2-8083-4d32-8acd-ca7b9c48ea37 with Priority: HIGHEST for action port [ 935.436587] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fd82ec2-8083-4d32-8acd-ca7b9c48ea37 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.436695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fd82ec2-8083-4d32-8acd-ca7b9c48ea37" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.436695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fd82ec2-8083-4d32-8acd-ca7b9c48ea37" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.436955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fd82ec2-8083-4d32-8acd-ca7b9c48ea37" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.437119] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fd82ec2-8083-4d32-8acd-ca7b9c48ea37',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.872682] env[65678]: INFO networking_nsxv3.common.synchronization [req-4b30dc8f-0e6e-409b-aef5-7fe08e7d4a54 req-4aec8565-38f9-47dd-a387-af8b0c692c41 tempest-InstanceActionsV221TestJSON-1487170191 tempest-InstanceActionsV221TestJSON-1487170191-project-member] Enqueued Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGHEST for action security_group_members [ 935.873390] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGHEST for action security_group_members [ 935.874023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-009db6c2-7197-4126-8d71-ff2f27ca91b3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.874023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.874023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.875409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.875875] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.876149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.876302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.877246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.877554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.877673] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('009db6c2-7197-4126-8d71-ff2f27ca91b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.897255] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e5b48c3-697e-4d97-b69f-490dfab919eb req-1a2bf822-a659-4cbb-93f6-d1a03627364f service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 935.897494] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e5b48c3-697e-4d97-b69f-490dfab919eb req-1a2bf822-a659-4cbb-93f6-d1a03627364f service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 935.898214] env[65678]: INFO networking_nsxv3.common.synchronization [req-7e5b48c3-697e-4d97-b69f-490dfab919eb req-1a2bf822-a659-4cbb-93f6-d1a03627364f service nova] Enqueued Resource ID: c5af7078-c088-43f5-86e4-32c3096195b2 with Priority: HIGHEST for action port [ 935.899142] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 935.899324] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 935.899527] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5af7078-c088-43f5-86e4-32c3096195b2 with Priority: HIGHEST for action port [ 935.899979] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.900692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.900692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.900692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.900906] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.901691] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.901827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.902162] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5af7078-c088-43f5-86e4-32c3096195b2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.902302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5af7078-c088-43f5-86e4-32c3096195b2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.902302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5af7078-c088-43f5-86e4-32c3096195b2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.902896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5af7078-c088-43f5-86e4-32c3096195b2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.903072] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5af7078-c088-43f5-86e4-32c3096195b2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.939407] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fd82ec2-8083-4d32-8acd-ca7b9c48ea37 [ 935.939782] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.939954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.940063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.940284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.940376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.940471] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fd82ec2-8083-4d32-8acd-ca7b9c48ea37 already deleted. [ 935.940807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fd82ec2-8083-4d32-8acd-ca7b9c48ea37" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.380578] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.380866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.380866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.381259] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.381259] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.381463] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.381577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.381635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.381757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.382082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.382189] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 is going to be updated. [ 936.406865] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.407040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.408481] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5af7078-c088-43f5-86e4-32c3096195b2 with status ACTIVE [ 936.408481] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.408481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.408481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.408481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.408481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.408481] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.408481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.408481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.408481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.408481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.409207] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.409207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.409207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.409207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.409207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.409207] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5af7078-c088-43f5-86e4-32c3096195b2 is going to be updated. [ 936.420316] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.420316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.420458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.420675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.420928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.431355] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 in Status: IN_PROGRESS for 2s [ 936.435142] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.435337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.435524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.435744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.435881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.436075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5af7078-c088-43f5-86e4-32c3096195b2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.758400] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 936.758587] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d deletion is rescheduled due to dependency. [ 936.758705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.758877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.759119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.759313] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.759454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.759524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.759678] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.759758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.759854] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.838190] env[65678]: INFO networking_nsxv3.common.synchronization [req-62c39e87-16a6-405a-8760-6f8b2bb6dc29 req-f0e5e8b8-646c-438b-a1e3-f169862b5c33 tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 936.838822] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 936.841466] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.841638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.841709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.841966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.843684] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.843684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.843684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.843684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.843684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.843684] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.264686] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.347138] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.717052] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.717052] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.717052] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.717439] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.717760] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.717760] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.717896] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.718056] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.719034] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.719034] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.719034] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.719034] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.719034] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.719034] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.719034] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.719034] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.740083] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.740265] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.740437] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.740802] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.740927] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-8f16e72f-f5fb-4b8c-b005-14e4cadba859 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.742364] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-8f16e72f-f5fb-4b8c-b005-14e4cadba859" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.742530] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-8f16e72f-f5fb-4b8c-b005-14e4cadba859" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.742901] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-8f16e72f-f5fb-4b8c-b005-14e4cadba859" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.743096] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f16e72f-f5fb-4b8c-b005-14e4cadba859',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.767400] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.850972] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.088574] env[65678]: INFO networking_nsxv3.common.synchronization [None req-95507305-3b2e-4230-96ae-5bb72baaeb6f None None] Enqueued Resource ID: b4324075-6387-4c16-9368-c072ee9c92f7 with Priority: HIGHEST for action port [ 938.088574] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4324075-6387-4c16-9368-c072ee9c92f7 with Priority: HIGHEST for action port [ 938.089023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4324075-6387-4c16-9368-c072ee9c92f7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.089196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4324075-6387-4c16-9368-c072ee9c92f7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.089284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4324075-6387-4c16-9368-c072ee9c92f7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.089565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4324075-6387-4c16-9368-c072ee9c92f7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.089929] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4324075-6387-4c16-9368-c072ee9c92f7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.247276] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.247727] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.247727] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.247975] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.248145] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.248300] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 8f16e72f-f5fb-4b8c-b005-14e4cadba859 not found, creating... [ 938.248567] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.248723] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.248837] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.249348] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.249490] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.249773] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.249942] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.250072] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.250289] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.250419] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.250554] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 8f16e72f-f5fb-4b8c-b005-14e4cadba859 is going to be created. [ 938.272083] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.272083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.272083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.272083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.272083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.272083] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 938.272999] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.273538] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.273787] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.274194] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.274916] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.275362] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-8f16e72f-f5fb-4b8c-b005-14e4cadba859" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.312420] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.312592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.312663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.312931] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.313221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.323486] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 938.354989] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.355206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.355310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.355601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.355727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.355862] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 938.409872] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.410072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.410072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.410299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.410443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.424989] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 938.450619] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 in Status: SUCCESS [ 938.450818] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 deletion is rescheduled due to dependency. [ 938.450983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.592884] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4324075-6387-4c16-9368-c072ee9c92f7 [ 938.593029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.593162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.593162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.593377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.593479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.593958] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4324075-6387-4c16-9368-c072ee9c92f7 already deleted. [ 938.593958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4324075-6387-4c16-9368-c072ee9c92f7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.011479] env[65678]: INFO networking_nsxv3.common.synchronization [req-62c39e87-16a6-405a-8760-6f8b2bb6dc29 req-041eea2d-1d1c-4d49-a857-0de102f2c3c3 service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 939.011479] env[65678]: INFO networking_nsxv3.common.synchronization [req-62c39e87-16a6-405a-8760-6f8b2bb6dc29 req-041eea2d-1d1c-4d49-a857-0de102f2c3c3 service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 939.011479] env[65678]: INFO networking_nsxv3.common.synchronization [req-62c39e87-16a6-405a-8760-6f8b2bb6dc29 req-041eea2d-1d1c-4d49-a857-0de102f2c3c3 service nova] Enqueued Resource ID: 8f16e72f-f5fb-4b8c-b005-14e4cadba859 with Priority: HIGHEST for action port [ 939.011479] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 939.011479] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 939.011479] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f16e72f-f5fb-4b8c-b005-14e4cadba859 with Priority: HIGHEST for action port [ 939.012029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.012029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.012029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.012029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.012029] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.014081] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.014081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.014081] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f16e72f-f5fb-4b8c-b005-14e4cadba859 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.014081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f16e72f-f5fb-4b8c-b005-14e4cadba859" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.014081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f16e72f-f5fb-4b8c-b005-14e4cadba859" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.014081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f16e72f-f5fb-4b8c-b005-14e4cadba859" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.014081] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f16e72f-f5fb-4b8c-b005-14e4cadba859',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.518793] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.518793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.518793] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f16e72f-f5fb-4b8c-b005-14e4cadba859 with status ACTIVE [ 939.518793] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.518793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.518793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.518793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.518793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.518793] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.518793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.518793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.518793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.518793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.518793] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.519554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.519554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.519554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.519554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.519554] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f16e72f-f5fb-4b8c-b005-14e4cadba859 is going to be updated. [ 939.544497] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.545040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.545040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.545040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.545214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.545256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f16e72f-f5fb-4b8c-b005-14e4cadba859" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.559022] env[65678]: INFO networking_nsxv3.common.synchronization [req-e176ddb8-288a-4103-9d9d-69c2484c7c19 req-0a073220-b7b4-4405-b878-dc9d0b40e0e5 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 939.559022] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 939.559529] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.559865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.560123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.560534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.561050] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.561284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.562782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.562782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.562782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.562782] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.960302] env[65678]: INFO networking_nsxv3.common.synchronization [None req-2b2a43ef-592b-4f20-9d0b-770af9fb3ee4 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 939.960858] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 939.961546] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.961681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.063641] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.337071] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 940.337335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.337505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.337817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.337920] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.338069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.338114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.338252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.338335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.338420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.338509] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.436545] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 940.436758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.437016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.437280] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.437558] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.437718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.437718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.437782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.437895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.437957] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.567400] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.843468] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.844791] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.844791] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.844791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.845288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.845288] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.845288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.845288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.845434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.845434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.845585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.845585] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.940011] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.071962] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.072304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.072304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.072530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.072626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.072739] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 941.106299] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.106445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.106508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.106721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.106864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.117244] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 941.348647] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d: rpc.has_security_group_logging(os_id): False [ 941.378832] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.379194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.379330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.379671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.379829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.380216] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.380431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.380566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.380862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.381033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.381412] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.381596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.381725] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.381989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.382154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.382515] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.382694] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.382872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.383209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.383413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.383567] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 941.442865] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.480039] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.480039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.480302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.480302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.480505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.501428] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 941.945755] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.946071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.946071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.946288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.946435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.946584] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 941.981603] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.981752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.981825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.982075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.982220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.998829] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 943.129094] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 943.129473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.129473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.129692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.129916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.130120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.130233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.130454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.130571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.131155] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.476772] env[65678]: INFO networking_nsxv3.common.synchronization [req-491d7c57-2ef6-454b-ab4a-966258bf5c80 req-9415edab-bad9-4ebc-840f-809a73eac16e tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_members [ 943.477978] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGHEST for action security_group_members [ 943.477978] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e857e4d2-27dd-462e-87df-ee44911ff684 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.478214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.478258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.478558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.478607] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.480028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.480028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.480028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.480028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.480028] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e857e4d2-27dd-462e-87df-ee44911ff684',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.529300] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 943.529539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.632946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.633153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.633237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.633491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.633597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.633802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.633902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.633960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.634168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.634257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.634350] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 943.676032] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.676200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.676248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.676459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.676570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.687662] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 943.981697] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.981877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.981951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.982166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.016731] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 944.017393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.017469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.018076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.018180] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.018502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.018502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.019516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.019516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.019516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.019516] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.024476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.024476] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.024804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.024804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.024935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.024990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.025127] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e857e4d2-27dd-462e-87df-ee44911ff684 is going to be updated. [ 944.071117] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.071117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.071117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.071310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.071341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.085828] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e857e4d2-27dd-462e-87df-ee44911ff684 in Status: IN_PROGRESS for 2s [ 944.218903] env[65678]: INFO networking_nsxv3.common.synchronization [req-01fd5889-6c86-459e-ae53-c24a29cb5f69 req-389b67df-464d-4a44-8538-18f0d445b32c tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_members [ 944.219942] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGHEST for action security_group_members [ 944.220362] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d196335c-3d4b-49d3-91d2-49ab0c720654 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.220547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.220597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.221252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.221369] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.221479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.221615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.222896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.222896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.222896] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.522795] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.523018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.523109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.523385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.523572] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.523683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.523763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.523916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.524099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.524099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.524274] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.524361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.524423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.524529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.524664] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.524753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.524819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.524966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.525055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.525509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.525509] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.724329] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.724529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.724691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.724845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.750550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.752466] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.752466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.752466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.752466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.752466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.752466] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d196335c-3d4b-49d3-91d2-49ab0c720654 is going to be updated. [ 944.786095] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.786305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.786376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.786610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.786754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.799461] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d196335c-3d4b-49d3-91d2-49ab0c720654 in Status: IN_PROGRESS for 2s [ 945.030419] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c: rpc.has_security_group_logging(os_id): False [ 945.051729] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.051935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.052827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.052827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.052827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.052827] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.052827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.052827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.052827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.053197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.053197] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.053197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.053311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.055096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.055096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.055096] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.055096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.055334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.055334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.055334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.055445] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 945.131025] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.131025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.131025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.131025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.131025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.151052] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 945.701270] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 945.701548] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 deletion is rescheduled due to dependency. [ 945.701583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.098396] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e857e4d2-27dd-462e-87df-ee44911ff684 in Status: SUCCESS [ 946.098578] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e857e4d2-27dd-462e-87df-ee44911ff684 deletion is rescheduled due to dependency. [ 946.098725] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e857e4d2-27dd-462e-87df-ee44911ff684" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.805032] env[65678]: INFO networking_nsxv3.common.synchronization [None req-b36d070a-f79f-4e81-b47b-9a17bb41b5e0 None None] Enqueued Resource ID: 83382ab9-be16-4dca-b916-7e192a145f42 with Priority: HIGHEST for action port [ 946.805288] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83382ab9-be16-4dca-b916-7e192a145f42 with Priority: HIGHEST for action port [ 946.806033] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-83382ab9-be16-4dca-b916-7e192a145f42 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.806033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83382ab9-be16-4dca-b916-7e192a145f42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.806033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83382ab9-be16-4dca-b916-7e192a145f42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.806543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83382ab9-be16-4dca-b916-7e192a145f42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.806671] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83382ab9-be16-4dca-b916-7e192a145f42',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.814917] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d196335c-3d4b-49d3-91d2-49ab0c720654 in Status: SUCCESS [ 946.815256] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d196335c-3d4b-49d3-91d2-49ab0c720654 deletion is rescheduled due to dependency. [ 946.815299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.080630] env[65678]: INFO networking_nsxv3.common.synchronization [req-f4a5bc15-49b0-4ac3-8be1-ae5fee35b41b req-49c9363e-6490-456e-8962-e77f900aba9a tempest-SecurityGroupRulesNegativeTestJSON-1589077270 tempest-SecurityGroupRulesNegativeTestJSON-1589077270-project-member] Enqueued Resource ID: 49629efe-c2ae-46ee-b8d6-db8680da2fe9 with Priority: HIGHEST for action security_group_rules [ 947.081924] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49629efe-c2ae-46ee-b8d6-db8680da2fe9 with Priority: HIGHEST for action security_group_rules [ 947.081924] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.082268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.082373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.082769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.083106] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49629efe-c2ae-46ee-b8d6-db8680da2fe9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.170886] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 947.171338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.309230] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83382ab9-be16-4dca-b916-7e192a145f42 [ 947.309478] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.309627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.309673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.309893] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.309980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.310092] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83382ab9-be16-4dca-b916-7e192a145f42 already deleted. [ 947.310172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83382ab9-be16-4dca-b916-7e192a145f42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.604094] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.604257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.604849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.604849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.604849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.604849] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49629efe-c2ae-46ee-b8d6-db8680da2fe9 already deleted. [ 947.604849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.369636] env[65678]: INFO networking_nsxv3.common.synchronization [req-d6255930-e56b-424a-8887-2a6e7829832f req-ac5c7ade-ab1d-4c1f-939b-1066ed50f9f5 tempest-SecurityGroupRulesNegativeTestJSON-1589077270 tempest-SecurityGroupRulesNegativeTestJSON-1589077270-project-member] Enqueued Resource ID: 49629efe-c2ae-46ee-b8d6-db8680da2fe9 with Priority: HIGHEST for action security_group_rules [ 948.370542] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49629efe-c2ae-46ee-b8d6-db8680da2fe9 with Priority: HIGHEST for action security_group_rules [ 948.371336] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.371336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.371336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.371851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.371851] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49629efe-c2ae-46ee-b8d6-db8680da2fe9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.404853] env[65678]: INFO networking_nsxv3.common.synchronization [None req-d526f76d-b252-4f55-9a53-4c56339e8a87 None None] Enqueued Resource ID: 54714558-8f12-4d2d-95dc-d904033b02ae with Priority: HIGHEST for action port [ 948.404853] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54714558-8f12-4d2d-95dc-d904033b02ae with Priority: HIGHEST for action port [ 948.404853] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-54714558-8f12-4d2d-95dc-d904033b02ae taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.404853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54714558-8f12-4d2d-95dc-d904033b02ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.404853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54714558-8f12-4d2d-95dc-d904033b02ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.404853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54714558-8f12-4d2d-95dc-d904033b02ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.404853] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54714558-8f12-4d2d-95dc-d904033b02ae',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.909352] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.909352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.909352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.909352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.909352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.909352] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49629efe-c2ae-46ee-b8d6-db8680da2fe9 already deleted. [ 948.909352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49629efe-c2ae-46ee-b8d6-db8680da2fe9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.909352] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54714558-8f12-4d2d-95dc-d904033b02ae [ 948.909352] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.909352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.909352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.909352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.909352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.909352] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54714558-8f12-4d2d-95dc-d904033b02ae already deleted. [ 948.910371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54714558-8f12-4d2d-95dc-d904033b02ae" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.572686] env[65678]: INFO networking_nsxv3.common.synchronization [req-fcfc50bb-4ec4-4e81-b626-5b10111caa6f req-2183fa8a-2881-4c9b-80d0-828b2fdc49e6 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 949.573372] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 949.576649] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.576649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.576649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.576649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.576649] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.576649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.576649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.576649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.576649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.576649] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.078807] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.086901] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.087153] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.087299] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.087886] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.087977] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.089241] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.089241] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.089241] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.089241] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.089241] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.089241] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.089241] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.089642] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.089642] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.089642] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.091044] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.114349] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.115100] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 950.115254] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.115447] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.115777] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-d85174f0-b637-4f5a-b153-8bdb70c45022 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.115948] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-d85174f0-b637-4f5a-b153-8bdb70c45022" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.116077] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-d85174f0-b637-4f5a-b153-8bdb70c45022" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.116412] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-d85174f0-b637-4f5a-b153-8bdb70c45022" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.116544] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d85174f0-b637-4f5a-b153-8bdb70c45022',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.586398] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.619744] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.619977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.620098] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.620488] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.620673] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.620865] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port d85174f0-b637-4f5a-b153-8bdb70c45022 not found, creating... [ 950.621271] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.621524] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.621678] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.621971] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.622106] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.623867] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.624096] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.624196] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.624439] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.624578] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.624722] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: d85174f0-b637-4f5a-b153-8bdb70c45022 is going to be created. [ 950.648203] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.648424] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.648560] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.648847] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.649085] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.649358] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-d85174f0-b637-4f5a-b153-8bdb70c45022" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.071336] env[65678]: INFO networking_nsxv3.common.synchronization [None req-99aba0f4-9177-40b6-9b87-4fe3b0316d05 None None] Enqueued Resource ID: 526cd244-7221-471c-9891-c7781dbafb22 with Priority: HIGHEST for action port [ 951.072124] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 526cd244-7221-471c-9891-c7781dbafb22 with Priority: HIGHEST for action port [ 951.073989] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-526cd244-7221-471c-9891-c7781dbafb22 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.073989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-526cd244-7221-471c-9891-c7781dbafb22" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.073989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-526cd244-7221-471c-9891-c7781dbafb22" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.073989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-526cd244-7221-471c-9891-c7781dbafb22" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.073989] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('526cd244-7221-471c-9891-c7781dbafb22',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.089091] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.089333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.089401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.089684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.089767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.089841] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 951.119723] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.119980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.119980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.120213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.120395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.133538] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 951.391408] env[65678]: INFO networking_nsxv3.common.synchronization [req-fcfc50bb-4ec4-4e81-b626-5b10111caa6f req-ba4bb1ce-56cd-4f47-a539-67900057f095 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 951.391592] env[65678]: INFO networking_nsxv3.common.synchronization [req-fcfc50bb-4ec4-4e81-b626-5b10111caa6f req-ba4bb1ce-56cd-4f47-a539-67900057f095 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 951.391724] env[65678]: INFO networking_nsxv3.common.synchronization [req-fcfc50bb-4ec4-4e81-b626-5b10111caa6f req-ba4bb1ce-56cd-4f47-a539-67900057f095 service nova] Enqueued Resource ID: d85174f0-b637-4f5a-b153-8bdb70c45022 with Priority: HIGHEST for action port [ 951.392297] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 951.392392] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 951.392494] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d85174f0-b637-4f5a-b153-8bdb70c45022 with Priority: HIGHEST for action port [ 951.392952] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.392952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.393196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.394142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.396861] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.396861] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.396861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.396861] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d85174f0-b637-4f5a-b153-8bdb70c45022 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.396861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d85174f0-b637-4f5a-b153-8bdb70c45022" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.396861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d85174f0-b637-4f5a-b153-8bdb70c45022" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.396861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d85174f0-b637-4f5a-b153-8bdb70c45022" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.396861] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d85174f0-b637-4f5a-b153-8bdb70c45022',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.575621] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 526cd244-7221-471c-9891-c7781dbafb22 [ 951.576043] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.576213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.576364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.576584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.576679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.576780] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:526cd244-7221-471c-9891-c7781dbafb22 already deleted. [ 951.576867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-526cd244-7221-471c-9891-c7781dbafb22" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.899640] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.899640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.899640] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d85174f0-b637-4f5a-b153-8bdb70c45022 with status ACTIVE [ 951.899640] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.899640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.899640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.900503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.900503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.900503] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.900503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.900503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.900503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.900503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.900712] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.900757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.900786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.900917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.901044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.901682] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d85174f0-b637-4f5a-b153-8bdb70c45022 is going to be updated. [ 951.936389] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.937587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.937587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.937587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.937587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.937587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d85174f0-b637-4f5a-b153-8bdb70c45022" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.146025] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 953.146025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.146025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.146025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.146025] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.146025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.146025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.146025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.146025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.146025] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.649084] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.152278] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.323883] env[65678]: INFO networking_nsxv3.common.synchronization [None req-2cbf3d74-5a31-4e80-a5d3-39b8dce3e0ce None None] Enqueued Resource ID: c383a4fb-1357-4df5-ad1d-b5232c72a71c with Priority: HIGHEST for action port [ 954.325491] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c383a4fb-1357-4df5-ad1d-b5232c72a71c with Priority: HIGHEST for action port [ 954.326136] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c383a4fb-1357-4df5-ad1d-b5232c72a71c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.326310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c383a4fb-1357-4df5-ad1d-b5232c72a71c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.326409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c383a4fb-1357-4df5-ad1d-b5232c72a71c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.326781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c383a4fb-1357-4df5-ad1d-b5232c72a71c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.326905] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c383a4fb-1357-4df5-ad1d-b5232c72a71c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.654577] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.654675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.654728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.656999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.656999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.656999] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 954.684574] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e2b8acbf-82ea-4931-a4c3-cbaaac959fe8 None None] Enqueued Resource ID: e0f69b38-af24-4164-8610-2108f50f73b1 with Priority: HIGHEST for action port [ 954.685559] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0f69b38-af24-4164-8610-2108f50f73b1 with Priority: HIGHEST for action port [ 954.685870] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0f69b38-af24-4164-8610-2108f50f73b1 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.686025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0f69b38-af24-4164-8610-2108f50f73b1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.686088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0f69b38-af24-4164-8610-2108f50f73b1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.686358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0f69b38-af24-4164-8610-2108f50f73b1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.687575] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0f69b38-af24-4164-8610-2108f50f73b1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.691096] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.691195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.691195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.691399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.692053] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.703981] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 954.829605] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c383a4fb-1357-4df5-ad1d-b5232c72a71c [ 954.829944] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.830689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.830689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.830689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.830689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.830689] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c383a4fb-1357-4df5-ad1d-b5232c72a71c already deleted. [ 954.830689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c383a4fb-1357-4df5-ad1d-b5232c72a71c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.188397] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0f69b38-af24-4164-8610-2108f50f73b1 [ 955.188669] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.189453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.189453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.189453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.189453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.189453] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0f69b38-af24-4164-8610-2108f50f73b1 already deleted. [ 955.189453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0f69b38-af24-4164-8610-2108f50f73b1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.716111] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 956.716609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.718663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.718950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.719205] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.719285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.719620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.719830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.719921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.720019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.720113] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.757590] env[65678]: INFO networking_nsxv3.common.synchronization [None req-7e912c83-3ec8-4bb7-8349-a6d3efe4e677 None None] Enqueued Resource ID: 90403dea-72b5-4979-9965-5b4b49372f86 with Priority: HIGHEST for action port [ 956.758119] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90403dea-72b5-4979-9965-5b4b49372f86 with Priority: HIGHEST for action port [ 956.758444] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-90403dea-72b5-4979-9965-5b4b49372f86 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.758552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90403dea-72b5-4979-9965-5b4b49372f86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.758607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90403dea-72b5-4979-9965-5b4b49372f86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.758857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90403dea-72b5-4979-9965-5b4b49372f86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.758939] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90403dea-72b5-4979-9965-5b4b49372f86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.224745] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.225022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.225100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.225324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.225498] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.225594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.225714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.225874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.225957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.226058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.226218] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.226308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.226365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.226506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.226696] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.226751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.226785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.226903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.226975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.227073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.227754] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.261976] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90403dea-72b5-4979-9965-5b4b49372f86 [ 957.262703] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.262703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.262993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.263345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.263467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.263619] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90403dea-72b5-4979-9965-5b4b49372f86 already deleted. [ 957.263804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90403dea-72b5-4979-9965-5b4b49372f86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.420090] env[65678]: INFO networking_nsxv3.common.synchronization [req-037dfdc0-0db2-45ce-ba52-3bd206eb5b56 req-f988dbb9-0f9b-42e8-bf0f-202034c8f095 tempest-VolumesAdminNegativeTest-1293295577 tempest-VolumesAdminNegativeTest-1293295577-project-member] Enqueued Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGHEST for action security_group_members [ 957.420736] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGHEST for action security_group_members [ 957.421134] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0fa044-c782-451f-a03f-5161e22ff3ca taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.421269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.421326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.422491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.422491] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.422491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.422491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.422491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.422491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.422491] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be0fa044-c782-451f-a03f-5161e22ff3ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.731988] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79cab93f-aae5-467c-88f3-35382c30a4ef: rpc.has_security_group_logging(os_id): False [ 957.753322] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.753491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.753574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.753834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.754372] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.754445] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.757028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.757028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.757028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.757028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.757028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.757028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.757028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.757028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.757028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.757028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.757857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.759831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.759831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.759831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.759831] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 957.825853] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.826055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.826167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.826330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.826485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.843424] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 957.852246] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.852486] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-920" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.852640] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-920" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.853350] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-920" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.854102] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.854102] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.854102] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.854452] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.854596] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.854856] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.855065] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.855108] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.855261] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.855371] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.855514] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.855662] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.877666] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.877666] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 957.877666] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.877874] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-920" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.878169] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-03447012-0075-49fe-ab13-0147b3b08db5 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.878304] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-03447012-0075-49fe-ab13-0147b3b08db5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.878462] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-03447012-0075-49fe-ab13-0147b3b08db5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.878718] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-03447012-0075-49fe-ab13-0147b3b08db5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.878854] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03447012-0075-49fe-ab13-0147b3b08db5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.926560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.926560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.926560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.926560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.926560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.926560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.926560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.926560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.926560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.927028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.927028] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be0fa044-c782-451f-a03f-5161e22ff3ca already deleted. [ 957.927028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.036213] env[65678]: INFO networking_nsxv3.common.synchronization [None req-504bf3d8-1cee-4328-9b5e-0c73ba899284 tempest-AttachVolumeTestJSON-242852111 tempest-AttachVolumeTestJSON-242852111-project-member] Enqueued Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_rules [ 958.036720] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_rules [ 958.037420] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cad1a85-e250-44ba-929f-39b2137bd736 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.037420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.037420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.038555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.038555] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.224891] env[65678]: INFO networking_nsxv3.common.synchronization [None req-3b567ea4-7807-424b-af22-4fbaf3e08148 tempest-AttachVolumeTestJSON-242852111 tempest-AttachVolumeTestJSON-242852111-project-member] Enqueued Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_rules [ 958.225533] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_rules [ 958.226741] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cad1a85-e250-44ba-929f-39b2137bd736 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.226741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.382484] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.382702] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.385481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.385481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.385481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.385481] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 03447012-0075-49fe-ab13-0147b3b08db5 not found, creating... [ 958.385481] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.385481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.385481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.385481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.385481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.385481] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.385908] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.385908] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.385908] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.385908] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.388818] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 03447012-0075-49fe-ab13-0147b3b08db5 is going to be created. [ 958.410350] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.410612] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.410688] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.411692] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.411934] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.412184] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-03447012-0075-49fe-ab13-0147b3b08db5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.568036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.568231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.568231] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.568509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.568600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.568639] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cad1a85-e250-44ba-929f-39b2137bd736 already deleted. [ 958.568724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.568880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.569050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.569159] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.098431] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.098431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.098431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.098431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.098431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.098431] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cad1a85-e250-44ba-929f-39b2137bd736 already deleted. [ 959.098431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.324474] env[65678]: INFO networking_nsxv3.common.synchronization [req-037dfdc0-0db2-45ce-ba52-3bd206eb5b56 req-b1bc492b-766c-41cc-afe7-13d394d78d01 service nova] Enqueued Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGHEST for action security_group_rules [ 959.324642] env[65678]: INFO networking_nsxv3.common.synchronization [req-037dfdc0-0db2-45ce-ba52-3bd206eb5b56 req-b1bc492b-766c-41cc-afe7-13d394d78d01 service nova] Enqueued Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGHEST for action security_group_members [ 959.324804] env[65678]: INFO networking_nsxv3.common.synchronization [req-037dfdc0-0db2-45ce-ba52-3bd206eb5b56 req-b1bc492b-766c-41cc-afe7-13d394d78d01 service nova] Enqueued Resource ID: 03447012-0075-49fe-ab13-0147b3b08db5 with Priority: HIGHEST for action port [ 959.325489] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGHEST for action security_group_rules [ 959.325489] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGHEST for action security_group_members [ 959.325584] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03447012-0075-49fe-ab13-0147b3b08db5 with Priority: HIGHEST for action port [ 959.325871] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be0fa044-c782-451f-a03f-5161e22ff3ca taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.326017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.326112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.326332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.326422] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be0fa044-c782-451f-a03f-5161e22ff3ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.327681] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0fa044-c782-451f-a03f-5161e22ff3ca taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.327937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.327937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.328505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.328706] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.328822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.329161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.329161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.329161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.329443] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be0fa044-c782-451f-a03f-5161e22ff3ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.330676] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-03447012-0075-49fe-ab13-0147b3b08db5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.330816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03447012-0075-49fe-ab13-0147b3b08db5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.330887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03447012-0075-49fe-ab13-0147b3b08db5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.331392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03447012-0075-49fe-ab13-0147b3b08db5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.331485] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03447012-0075-49fe-ab13-0147b3b08db5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.831363] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be0fa044-c782-451f-a03f-5161e22ff3ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.837560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0fa044-c782-451f-a03f-5161e22ff3ca taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.837560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.859871] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 959.860133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.187853] env[65678]: INFO networking_nsxv3.common.synchronization [req-e909240e-0580-4110-88f7-7528a32f2745 req-6ae1656b-f967-4b86-b343-72bb39cbd9d2 tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 960.192022] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 960.192022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.192022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.192022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.192022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.192022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.192022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.192022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.192022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.192022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.192022] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.334608] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be0fa044-c782-451f-a03f-5161e22ff3ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.334608] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03447012-0075-49fe-ab13-0147b3b08db5 with status ACTIVE [ 960.334608] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.334608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.334608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.334608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.334608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.335106] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.335106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.335106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.335216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.335913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.335913] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.335913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.335913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.336236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.336513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.336670] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03447012-0075-49fe-ab13-0147b3b08db5 is going to be updated. [ 960.361270] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.362806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.362806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.362806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.362806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.362806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03447012-0075-49fe-ab13-0147b3b08db5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.618326] env[65678]: INFO networking_nsxv3.common.synchronization [None req-ff11be97-a8eb-466d-97a5-fb6fcc09128a None None] Enqueued Resource ID: 71662552-5cea-4cef-b490-0f40edf18206 with Priority: HIGHEST for action port [ 960.619671] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71662552-5cea-4cef-b490-0f40edf18206 with Priority: HIGHEST for action port [ 960.620175] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-71662552-5cea-4cef-b490-0f40edf18206 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.621031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71662552-5cea-4cef-b490-0f40edf18206" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.621031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71662552-5cea-4cef-b490-0f40edf18206" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.621031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71662552-5cea-4cef-b490-0f40edf18206" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.621031] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71662552-5cea-4cef-b490-0f40edf18206',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.694950] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.703939] env[65678]: INFO networking_nsxv3.common.synchronization [None req-0c9ee976-7d63-40ac-b156-ccda67504c14 None None] Enqueued Resource ID: a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d with Priority: HIGHEST for action port [ 960.704524] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d with Priority: HIGHEST for action port [ 960.704823] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.704960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.705046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.705322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.705415] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.839727] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.839727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.839727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.840088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.840088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.840552] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be0fa044-c782-451f-a03f-5161e22ff3ca is going to be created. [ 960.869179] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.869179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.869179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.869179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.869179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.879115] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be0fa044-c782-451f-a03f-5161e22ff3ca in Status: UNINITIALIZED for 2s [ 961.124088] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71662552-5cea-4cef-b490-0f40edf18206 [ 961.124455] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.124635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.124753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.125018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.125164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.125328] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71662552-5cea-4cef-b490-0f40edf18206 already deleted. [ 961.125460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71662552-5cea-4cef-b490-0f40edf18206" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.198657] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.212465] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d [ 961.212465] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.212465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.212465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.212465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.212465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.212465] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d already deleted. [ 961.212465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6f63b06-c360-4ef4-bf0d-ff2b8baefe8d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.362697] env[65678]: INFO networking_nsxv3.common.synchronization [None req-a327a532-59c8-4e45-8d26-ccaf389fc22b tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_rules [ 961.363416] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_rules [ 961.363810] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.363975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.365210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.365660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.365660] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.518695] env[65678]: INFO networking_nsxv3.common.synchronization [None req-1efb511d-9571-4f62-93c1-f1920ebe1a82 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_rules [ 961.518695] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_rules [ 961.518695] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.518695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.701412] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.701412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.701412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.701412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.701412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.701683] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 961.741910] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.741910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.741910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.741910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.741910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.754383] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 961.824062] env[65678]: INFO networking_nsxv3.common.synchronization [None req-30c12f48-38ef-4dd5-9092-03185d353ca7 None None] Enqueued Resource ID: faa32741-21f7-431d-a23c-29df94347dee with Priority: HIGHEST for action port [ 961.826020] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa32741-21f7-431d-a23c-29df94347dee with Priority: HIGHEST for action port [ 961.826429] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-faa32741-21f7-431d-a23c-29df94347dee taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.829798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faa32741-21f7-431d-a23c-29df94347dee" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.829798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faa32741-21f7-431d-a23c-29df94347dee" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.829798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faa32741-21f7-431d-a23c-29df94347dee" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.829798] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faa32741-21f7-431d-a23c-29df94347dee',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.891118] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.891118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.891118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.891118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.891118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.891118] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3e6206b-217a-495f-93c5-643d3576e725 already deleted. [ 961.891118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.891118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.891118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.891118] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.337247] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faa32741-21f7-431d-a23c-29df94347dee [ 962.337579] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.337640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.337674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.337876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.337962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.338386] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faa32741-21f7-431d-a23c-29df94347dee already deleted. [ 962.338499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faa32741-21f7-431d-a23c-29df94347dee" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.418048] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.418048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.418048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.418048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.418048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.418048] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3e6206b-217a-495f-93c5-643d3576e725 already deleted. [ 962.418048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.894469] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be0fa044-c782-451f-a03f-5161e22ff3ca in Status: SUCCESS [ 962.894829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.894829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.895491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.895491] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.895491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.895491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.898204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.898204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.898204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.898204] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be0fa044-c782-451f-a03f-5161e22ff3ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.402482] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0fa044-c782-451f-a03f-5161e22ff3ca taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.402794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.402794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.402913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.403573] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.403733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.403813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.403999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.404111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.404219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.404383] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0fa044-c782-451f-a03f-5161e22ff3ca taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.404478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.404537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.404691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.404861] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.404950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.405027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.410848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.410848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.410848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.410848] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be0fa044-c782-451f-a03f-5161e22ff3ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.770432] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 963.770432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.875038] env[65678]: INFO networking_nsxv3.common.synchronization [req-32991417-1b73-4831-b363-f385c472d019 req-ce9b22a5-e31a-4e1d-b314-24e6b3ff6915 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 963.878146] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 963.878146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.878146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.878146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.878146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.878146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.879071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.879071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.879071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.879071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.879071] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.914218] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be0fa044-c782-451f-a03f-5161e22ff3ca: rpc.has_security_group_logging(os_id): False [ 963.940307] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.940604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.940604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.940740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.941032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.941032] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.941269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.941330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.941485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.941584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.941764] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.941869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.941921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.942071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.942353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.942972] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.942972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.942972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.942972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.942972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.943325] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be0fa044-c782-451f-a03f-5161e22ff3ca is going to be created. [ 964.020170] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.020170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.020170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.020583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.020583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.035178] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be0fa044-c782-451f-a03f-5161e22ff3ca in Status: IN_PROGRESS for 2s [ 964.399102] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.503411] env[65678]: INFO networking_nsxv3.common.synchronization [None req-fee5b5e6-8bc8-46db-8831-7e3a300c2f8f tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_rules [ 964.503732] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_rules [ 964.504104] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.504273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.504363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.507993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.508844] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.694794] env[65678]: INFO networking_nsxv3.common.synchronization [None req-891e07a8-b70a-49e2-b967-4596060be551 None None] Enqueued Resource ID: ab901dea-5772-4420-bf1a-970313c03ccc with Priority: HIGHEST for action port [ 964.695520] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab901dea-5772-4420-bf1a-970313c03ccc with Priority: HIGHEST for action port [ 964.695943] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab901dea-5772-4420-bf1a-970313c03ccc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.696152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab901dea-5772-4420-bf1a-970313c03ccc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.696264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab901dea-5772-4420-bf1a-970313c03ccc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.696634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab901dea-5772-4420-bf1a-970313c03ccc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.696763] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab901dea-5772-4420-bf1a-970313c03ccc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.722800] env[65678]: INFO networking_nsxv3.common.synchronization [None req-18b02bd0-1b99-4b19-b0e0-635b76240d4c tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_rules [ 964.723500] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_rules [ 964.723964] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.724098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.750596] env[65678]: INFO networking_nsxv3.common.synchronization [req-bc3dc377-df83-4976-a39a-daaaca2047a8 req-4a787dc4-166f-431d-93aa-08146a137d90 tempest-AttachVolumeShelveTestJSON-1282061189 tempest-AttachVolumeShelveTestJSON-1282061189-project-member] Enqueued Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_members [ 964.751189] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGHEST for action security_group_members [ 964.751645] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.751645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.751800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.751941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.752253] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.752253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.752253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.752402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.752450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.752510] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.905175] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.044155] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.046215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.046215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.046215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.046215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.046215] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b already deleted. [ 965.046215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.046731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.046998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.050519] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.200320] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab901dea-5772-4420-bf1a-970313c03ccc [ 965.200320] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.200320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.200320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.200590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.200590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.200652] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab901dea-5772-4420-bf1a-970313c03ccc already deleted. [ 965.200743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab901dea-5772-4420-bf1a-970313c03ccc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.256406] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.256557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.256621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.256844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.256948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.257273] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.257341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.257373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.257524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.257597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.257682] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 is going to be updated. [ 965.295847] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.295985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.297506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.299525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.299779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.312176] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: IN_PROGRESS for 2s [ 965.416256] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.416256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.416256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.416256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.416256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.416256] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 965.455912] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.456393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.456605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.456917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.457179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.472217] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 965.578369] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.578369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.578369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.578766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.578766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.578766] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b already deleted. [ 965.578915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.050928] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be0fa044-c782-451f-a03f-5161e22ff3ca in Status: SUCCESS [ 966.051325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.325157] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 in Status: SUCCESS [ 967.325157] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 deletion is rescheduled due to dependency. [ 967.325157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.482814] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 967.482814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.752067] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 969.752595] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 971.733979] env[65678]: INFO networking_nsxv3.common.synchronization [req-90927be5-8c15-436b-9956-8d143ca4b847 req-4712f989-19f8-4829-bd7f-e5026e760f67 tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 971.734688] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 971.735053] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.735193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.735264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.735933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.736149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.736265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.736404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.736546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.736638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.736913] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.140224] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.140533] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.140597] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.141477] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.141477] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.141477] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.141477] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.141856] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.141856] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.142060] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.142231] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.142361] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.142453] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.142563] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.142666] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.142794] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.166013] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.166206] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 972.166487] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.166530] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.166917] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.167118] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.167419] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.167797] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.167948] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fc1afc3-5e5f-474c-918a-f1fe57e1e22c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.239586] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.240194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.240194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.240353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.240353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.240851] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.240851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.240851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.241075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.241075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.241143] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 already deleted. [ 972.241177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.647974] env[65678]: INFO networking_nsxv3.common.synchronization [req-ee8e1083-19ed-4355-a816-5442c64d3297 req-27656970-e320-4161-8ece-258e71290fe1 tempest-ServersTestManualDisk-33820034 tempest-ServersTestManualDisk-33820034-project-member] Enqueued Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_members [ 972.647974] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGHEST for action security_group_members [ 972.647974] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-92e8fca5-1dcf-494d-a489-044a26543bc2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.647974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.647974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.647974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.647974] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.647974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.647974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.647974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.647974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.647974] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.674117] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.674117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.674117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.674117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.674117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.674117] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 5fc1afc3-5e5f-474c-918a-f1fe57e1e22c not found, creating... [ 972.674117] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.674117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.674117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.674117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.674117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.674682] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.674682] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.674682] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.674682] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.675206] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.675537] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 5fc1afc3-5e5f-474c-918a-f1fe57e1e22c is going to be created. [ 972.704026] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.704026] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.704026] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.704026] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.704026] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.704026] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.047551] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.047826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.047826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.048074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.048159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.048294] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.048388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.048438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.048583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.049159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.049159] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 is going to be updated. [ 973.082910] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.083149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.083149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.083376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.083519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.092681] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 in Status: IN_PROGRESS for 2s [ 973.152362] env[65678]: INFO networking_nsxv3.common.synchronization [req-8be3371b-48ad-40ee-aa1b-2b87c6e642e6 req-a6d6af26-3555-4d10-b05c-9bd864f2276c tempest-VolumesAdminNegativeTest-1293295577 tempest-VolumesAdminNegativeTest-1293295577-project-member] Enqueued Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGHEST for action security_group_members [ 973.153040] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGHEST for action security_group_members [ 973.153315] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0fa044-c782-451f-a03f-5161e22ff3ca taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.153445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.153504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.153708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.153892] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.154032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.154099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.154221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.154302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.154392] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be0fa044-c782-451f-a03f-5161e22ff3ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.470438] env[65678]: INFO networking_nsxv3.common.synchronization [req-90927be5-8c15-436b-9956-8d143ca4b847 req-94466c27-6977-4e81-95ee-527edc3c6c71 service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 973.470623] env[65678]: INFO networking_nsxv3.common.synchronization [req-90927be5-8c15-436b-9956-8d143ca4b847 req-94466c27-6977-4e81-95ee-527edc3c6c71 service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 973.470756] env[65678]: INFO networking_nsxv3.common.synchronization [req-90927be5-8c15-436b-9956-8d143ca4b847 req-94466c27-6977-4e81-95ee-527edc3c6c71 service nova] Enqueued Resource ID: 5fc1afc3-5e5f-474c-918a-f1fe57e1e22c with Priority: HIGHEST for action port [ 973.472160] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 973.472403] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 973.472481] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fc1afc3-5e5f-474c-918a-f1fe57e1e22c with Priority: HIGHEST for action port [ 973.473052] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.473052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.473052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.477283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.477283] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.480092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.480092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.480092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.480092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.480092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.480092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.480092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.480092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.480092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.480092] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.481765] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.481765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.481937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.482175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.482832] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fc1afc3-5e5f-474c-918a-f1fe57e1e22c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.656448] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.656686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.656686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.656891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.656975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.657418] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.657479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.657546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.657765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.657921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.658077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be0fa044-c782-451f-a03f-5161e22ff3ca is going to be updated. [ 973.691254] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.691471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.691471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.691659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.691798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.702731] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be0fa044-c782-451f-a03f-5161e22ff3ca in Status: IN_PROGRESS for 2s [ 973.979477] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.979477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.984947] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.985963] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fc1afc3-5e5f-474c-918a-f1fe57e1e22c with status ACTIVE [ 973.986276] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.986276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.986423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.986536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.986618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.986787] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.986873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.986932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.987923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.987923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.987923] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.987923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.987923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.987923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.987923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.987923] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fc1afc3-5e5f-474c-918a-f1fe57e1e22c is going to be updated. [ 974.014293] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.014293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.014293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.014555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.014608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.014760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fc1afc3-5e5f-474c-918a-f1fe57e1e22c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.261557] env[65678]: INFO networking_nsxv3.common.synchronization [req-d8c5e994-4dd9-4b1e-8738-4f8c6f65614e req-b4e80353-fea2-4ffa-ab92-04dbae1dccdb tempest-ServersAdminTestJSON-1252313613 tempest-ServersAdminTestJSON-1252313613-project-member] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 974.262015] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 974.262336] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.262446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.262524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.262762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.262910] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.263057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.263199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.263327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.263478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.263560] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.492088] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.630753] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.630934] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.631061] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.631450] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.632223] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.632223] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.632223] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.632223] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.632734] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.632734] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.632734] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.632734] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.632925] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.632925] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.633031] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.633180] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.652790] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.653519] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.653519] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.653519] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.653705] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-311ca27a-fdea-4b1d-99ff-30272eb8c026 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.653785] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-311ca27a-fdea-4b1d-99ff-30272eb8c026" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.653882] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-311ca27a-fdea-4b1d-99ff-30272eb8c026" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.654235] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-311ca27a-fdea-4b1d-99ff-30272eb8c026" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.654421] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('311ca27a-fdea-4b1d-99ff-30272eb8c026',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.765408] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.765538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.765591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.765786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.765879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.766088] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.766188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.766279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.766524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.766524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.766626] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 already deleted. [ 974.766661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.892411] env[65678]: INFO networking_nsxv3.common.synchronization [req-42308a2e-7320-47a7-be3d-f28754ca6d00 req-1a64ebb2-f4c3-4fab-a0f7-ce845bab1726 tempest-ServersTestBootFromVolume-2101032171 tempest-ServersTestBootFromVolume-2101032171-project-member] Enqueued Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_members [ 974.893316] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGHEST for action security_group_members [ 974.893908] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d87d2c-0ecc-4c94-9119-6c94790a0c86 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.894090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.894169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.894344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.894547] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.894665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.894729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.894884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.894968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.895077] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.995288] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.995530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.995579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.995796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.995886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.995989] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be created. [ 975.022957] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.023191] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.023278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.023521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.023663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.040913] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: UNINITIALIZED for 2s [ 975.104693] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 in Status: SUCCESS [ 975.104835] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 deletion is rescheduled due to dependency. [ 975.104952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.157920] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.157920] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.158602] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.158602] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.158602] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.158873] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 311ca27a-fdea-4b1d-99ff-30272eb8c026 not found, creating... [ 975.159120] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.159294] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.159419] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.159722] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.159935] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.160227] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.160382] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.160537] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.160780] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.160911] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.161164] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 311ca27a-fdea-4b1d-99ff-30272eb8c026 is going to be created. [ 975.183797] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.183797] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.184023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.184253] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.184497] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.184725] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-311ca27a-fdea-4b1d-99ff-30272eb8c026" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.398361] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.398650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.398650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.398803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.398897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.399167] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.399245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.399286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.399437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.399803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.399803] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 is going to be updated. [ 975.437687] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.437687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.437687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.437687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.438073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.453050] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 in Status: IN_PROGRESS for 2s [ 975.716922] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be0fa044-c782-451f-a03f-5161e22ff3ca in Status: SUCCESS [ 975.716922] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be0fa044-c782-451f-a03f-5161e22ff3ca deletion is rescheduled due to dependency. [ 975.716922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.899154] env[65678]: INFO networking_nsxv3.common.synchronization [req-d8c5e994-4dd9-4b1e-8738-4f8c6f65614e req-901d9fd9-9838-4798-b059-d7407444aa88 service nova] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_rules [ 975.899154] env[65678]: INFO networking_nsxv3.common.synchronization [req-d8c5e994-4dd9-4b1e-8738-4f8c6f65614e req-901d9fd9-9838-4798-b059-d7407444aa88 service nova] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 975.899154] env[65678]: INFO networking_nsxv3.common.synchronization [req-d8c5e994-4dd9-4b1e-8738-4f8c6f65614e req-901d9fd9-9838-4798-b059-d7407444aa88 service nova] Enqueued Resource ID: 311ca27a-fdea-4b1d-99ff-30272eb8c026 with Priority: HIGHEST for action port [ 975.899154] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_rules [ 975.899343] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 975.899505] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311ca27a-fdea-4b1d-99ff-30272eb8c026 with Priority: HIGHEST for action port [ 975.899974] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.900183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.900375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.902037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.902037] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.902374] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.903291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.903917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.904767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.905183] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.905344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.905532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.905713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.908037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.908037] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.908037] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-311ca27a-fdea-4b1d-99ff-30272eb8c026 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.908037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-311ca27a-fdea-4b1d-99ff-30272eb8c026" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.908037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-311ca27a-fdea-4b1d-99ff-30272eb8c026" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.908037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-311ca27a-fdea-4b1d-99ff-30272eb8c026" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.908037] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('311ca27a-fdea-4b1d-99ff-30272eb8c026',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.410820] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.413023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.413023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.413023] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 311ca27a-fdea-4b1d-99ff-30272eb8c026 with status ACTIVE [ 976.413023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.413023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.413023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.413358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.413407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.413644] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.413771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.413846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.414037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.414128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.414381] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.414495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.414574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.414734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.414832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.414910] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 311ca27a-fdea-4b1d-99ff-30272eb8c026 is going to be updated. [ 976.448297] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.448487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.448534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.448957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.449177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.449365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-311ca27a-fdea-4b1d-99ff-30272eb8c026" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.917963] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.051523] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 977.051828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.051970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.052205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.052388] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.052519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.052594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.052716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.052785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.052869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.052956] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.421357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.421738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.421738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.421892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.421951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.422065] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be created. [ 977.451106] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.451365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.451453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.451684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.451851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.466036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 in Status: SUCCESS [ 977.466222] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 deletion is rescheduled due to dependency. [ 977.466353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.467431] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: UNINITIALIZED for 2s [ 977.555321] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.555521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.555648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.555932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.556162] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.556307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.556379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.556694] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.556819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.556916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.557140] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.557192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.557294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.557426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.557644] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.557848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.557922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.558124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.558256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.558390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.558531] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.904182] env[65678]: INFO networking_nsxv3.common.synchronization [req-f711bd16-631c-477d-b714-3af192da25c2 req-7a6157f4-3e3d-4ce7-aee2-59af9bc5d565 tempest-ServersAdminTestJSON-1252313613 tempest-ServersAdminTestJSON-1252313613-project-member] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 977.904732] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 977.905064] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.905352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.062713] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50c43a13-ebd7-47b2-924e-039a5d7a4354: rpc.has_security_group_logging(os_id): False [ 978.080132] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.080334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.080396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.080576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.080663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.081102] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.081102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.081232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.081397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.081506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.081709] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.081814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.081877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.082035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.082112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.082389] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.082389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.082510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.082581] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.082650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.082735] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be created. [ 978.146076] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.146227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.146305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.146553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.146729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.158924] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 978.221643] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.221974] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.222215] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.222609] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.223029] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.223290] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.223484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.223840] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.224208] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.224486] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.224676] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.224861] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.225060] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.225256] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.225444] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.225662] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.252840] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.252840] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.253051] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.253413] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.253916] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-346d271b-3cca-4732-8a31-a95a0ea0ff42 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.254207] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-346d271b-3cca-4732-8a31-a95a0ea0ff42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.254404] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-346d271b-3cca-4732-8a31-a95a0ea0ff42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.254885] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-346d271b-3cca-4732-8a31-a95a0ea0ff42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.255338] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('346d271b-3cca-4732-8a31-a95a0ea0ff42',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.550051] env[65678]: INFO networking_nsxv3.common.synchronization [req-25c26eb8-b929-4e50-acb9-994fd62819e7 req-05a18d78-d31a-4f78-b5be-1f6ea6a60c29 tempest-ServerRescueNegativeTestJSON-113281034 tempest-ServerRescueNegativeTestJSON-113281034-project-member] Enqueued Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_members [ 978.550051] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGHEST for action security_group_members [ 978.550470] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-365d72a1-5a30-4ddf-b653-b2fb3c894c63 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.550470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.550470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.550599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.550725] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.550821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.550881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.551109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.551174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.551241] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365d72a1-5a30-4ddf-b653-b2fb3c894c63',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.759055] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.759472] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.759628] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.760017] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.760250] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.760462] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 346d271b-3cca-4732-8a31-a95a0ea0ff42 not found, creating... [ 978.760832] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.761123] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.761319] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.761652] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.761913] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.762321] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.762629] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.762731] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.763015] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.763231] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.763410] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 346d271b-3cca-4732-8a31-a95a0ea0ff42 is going to be created. [ 978.806241] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.806523] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.806660] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.806975] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.807355] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.807779] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-346d271b-3cca-4732-8a31-a95a0ea0ff42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.053196] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.053511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.053690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.053986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.054164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.054389] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.054487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.054550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.054711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.054788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.054876] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 is going to be updated. [ 979.084916] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.085175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.085251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.085484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.085622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.098158] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 in Status: IN_PROGRESS for 2s [ 979.495497] env[65678]: INFO networking_nsxv3.common.synchronization [req-f711bd16-631c-477d-b714-3af192da25c2 req-2d9121a0-400c-4c5f-a008-fc984b3431bd service nova] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_rules [ 979.495756] env[65678]: INFO networking_nsxv3.common.synchronization [req-f711bd16-631c-477d-b714-3af192da25c2 req-2d9121a0-400c-4c5f-a008-fc984b3431bd service nova] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 979.495756] env[65678]: INFO networking_nsxv3.common.synchronization [req-f711bd16-631c-477d-b714-3af192da25c2 req-2d9121a0-400c-4c5f-a008-fc984b3431bd service nova] Enqueued Resource ID: 346d271b-3cca-4732-8a31-a95a0ea0ff42 with Priority: HIGHEST for action port [ 979.497063] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_rules [ 979.497063] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 979.502240] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 346d271b-3cca-4732-8a31-a95a0ea0ff42 with Priority: HIGHEST for action port [ 979.502240] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.502240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.502240] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.502240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.502240] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-346d271b-3cca-4732-8a31-a95a0ea0ff42 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.502240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-346d271b-3cca-4732-8a31-a95a0ea0ff42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.502240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-346d271b-3cca-4732-8a31-a95a0ea0ff42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.502240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-346d271b-3cca-4732-8a31-a95a0ea0ff42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.502713] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('346d271b-3cca-4732-8a31-a95a0ea0ff42',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.572017] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 979.572459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.572459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.572695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.572804] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.572921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.572988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.573182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.573268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.573351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.573454] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.574317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.574488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.574674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.574783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.574982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.575039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.575121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.575208] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.004868] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 346d271b-3cca-4732-8a31-a95a0ea0ff42 with status ACTIVE [ 980.005614] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.005614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.005614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.005962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.005962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.006049] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.006180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.006223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.006505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.006505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.006657] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.007335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.007335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.007335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.007335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.007335] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 346d271b-3cca-4732-8a31-a95a0ea0ff42 is going to be updated. [ 980.029037] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.029294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.029401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.029670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.029819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.029999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-346d271b-3cca-4732-8a31-a95a0ea0ff42" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.077630] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.077769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.077974] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.174034] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 980.174034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.430767] env[65678]: INFO networking_nsxv3.common.synchronization [req-9b0ec141-af2a-4c57-9711-ae0f3e8303ea req-7c8cc529-0030-4b15-a27d-5f706fe98ee4 tempest-AttachVolumeTestJSON-242852111 tempest-AttachVolumeTestJSON-242852111-project-member] Enqueued Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_members [ 980.431417] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_members [ 980.431742] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cad1a85-e250-44ba-929f-39b2137bd736 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.431871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.431935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.432427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.432811] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.434141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.434232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.434456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.434556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.434707] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.580917] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.786725] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.786928] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-971" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.787068] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-971" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.787409] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-971" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.787682] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.787859] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.787989] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.788236] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.788388] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.788621] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.788838] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.788986] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.789118] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.789270] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.789389] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.789531] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.811857] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.812060] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 980.812180] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.812362] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-971" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.812673] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.812849] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.812967] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.813385] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.813520] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('126fb4c6-36e2-4d41-bf1b-01b8f67b7616',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.938054] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.938244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.938328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.938518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.938600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.938892] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.939023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.939023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.939148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.939216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.939435] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cad1a85-e250-44ba-929f-39b2137bd736 already deleted. [ 980.939435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.085153] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.085153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.085153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.085400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.085400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.085400] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 981.109242] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 in Status: SUCCESS [ 981.109505] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 deletion is rescheduled due to dependency. [ 981.109644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365d72a1-5a30-4ddf-b653-b2fb3c894c63" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.117702] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.117937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.117937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.118142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.118300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.127729] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 981.316444] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.316759] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.316895] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.317193] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.317361] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.317854] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 126fb4c6-36e2-4d41-bf1b-01b8f67b7616 not found, creating... [ 981.317854] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.318075] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.318075] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.318268] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.318408] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.318737] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.318895] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.319041] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.319258] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.319394] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.319532] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 126fb4c6-36e2-4d41-bf1b-01b8f67b7616 is going to be created. [ 981.353614] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.353967] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.354234] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.354636] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.354999] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.355375] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.133464] env[65678]: INFO networking_nsxv3.common.synchronization [req-9b0ec141-af2a-4c57-9711-ae0f3e8303ea req-c96a73f3-9a16-4ee3-8b80-ed8358c6f6ff service nova] Enqueued Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_rules [ 982.133799] env[65678]: INFO networking_nsxv3.common.synchronization [req-9b0ec141-af2a-4c57-9711-ae0f3e8303ea req-c96a73f3-9a16-4ee3-8b80-ed8358c6f6ff service nova] Enqueued Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_members [ 982.133799] env[65678]: INFO networking_nsxv3.common.synchronization [req-9b0ec141-af2a-4c57-9711-ae0f3e8303ea req-c96a73f3-9a16-4ee3-8b80-ed8358c6f6ff service nova] Enqueued Resource ID: 126fb4c6-36e2-4d41-bf1b-01b8f67b7616 with Priority: HIGHEST for action port [ 982.134379] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_rules [ 982.134770] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_members [ 982.134770] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126fb4c6-36e2-4d41-bf1b-01b8f67b7616 with Priority: HIGHEST for action port [ 982.135039] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cad1a85-e250-44ba-929f-39b2137bd736 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.135039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.139557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.139985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.140158] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.141490] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cad1a85-e250-44ba-929f-39b2137bd736 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.141696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.141759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.141948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.142240] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.142386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.142472] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.142643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.142759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.143081] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.144778] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.144903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.144955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.145107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.145215] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('126fb4c6-36e2-4d41-bf1b-01b8f67b7616',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.647583] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cad1a85-e250-44ba-929f-39b2137bd736 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.647746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.647894] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.649993] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 126fb4c6-36e2-4d41-bf1b-01b8f67b7616 with status ACTIVE [ 982.649993] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.649993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.649993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.649993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.649993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.649993] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.649993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.649993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.649993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.649993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.650557] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.650557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.650557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.650557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.650557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.650727] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 126fb4c6-36e2-4d41-bf1b-01b8f67b7616 is going to be updated. [ 982.675145] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.675274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.675274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.675896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.675896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.675896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-126fb4c6-36e2-4d41-bf1b-01b8f67b7616" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.138068] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 983.138461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.138461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.138653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.138831] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.138946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.139049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.139181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.139268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.139352] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.152361] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.524262] env[65678]: INFO networking_nsxv3.common.synchronization [req-b55cb839-7a9a-434c-a535-963ae80de93a req-f956e6cd-feec-4a02-b08c-898123390f2b tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 983.525193] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 983.525639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.525850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.525947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.526230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.526458] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.526592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.526676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.526897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.527054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.527190] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.641432] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.652426] env[65678]: INFO networking_nsxv3.common.synchronization [req-3da36b58-573a-42ba-be44-52df69c57c06 req-b6b918b0-5594-490a-b593-63d1370b9598 tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 983.652426] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 983.652742] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.652874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.652944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.653167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.653343] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.654121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.654121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.654121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.654121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.654121] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.655036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.655152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.655152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.655320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.655401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.655486] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cad1a85-e250-44ba-929f-39b2137bd736 is going to be created. [ 983.687794] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.687794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.687794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.688039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.688236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.701575] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cad1a85-e250-44ba-929f-39b2137bd736 in Status: UNINITIALIZED for 2s [ 984.029659] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.029961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.029961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.030504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.030719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.030982] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.031180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.031293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.031509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.031601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.031700] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 984.071864] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.071864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.072126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.072646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.072646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.083979] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 984.143741] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.158448] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.158638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.158680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.158880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.158964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.159181] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.159307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.159357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.159517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.159765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.159765] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 984.186777] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.186910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.186988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.187206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.187337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.197559] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 984.646454] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.646688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.646688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.646955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.647124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.647287] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 984.677548] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.677548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.677675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.677832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.677979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.687543] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 985.082433] env[65678]: INFO networking_nsxv3.common.synchronization [req-88f61546-80be-459e-a122-9ecd0e52a80a req-a4fae169-dfb5-4459-8cd1-22b8f8843e21 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_members [ 985.082433] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_members [ 985.083054] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.083054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.083054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.083310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.083476] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.083585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.083649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.083822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.083909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.084392] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.418068] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.418388] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.418434] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.418706] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.418968] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.419145] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.419264] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.419482] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.419631] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.419849] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.419988] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.420125] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.420236] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.420347] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.420450] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.420583] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.442491] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.442700] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.442860] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.443049] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.443600] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-6a57330a-ae8c-45e6-9517-7122b176550d taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.443878] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-6a57330a-ae8c-45e6-9517-7122b176550d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.444052] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-6a57330a-ae8c-45e6-9517-7122b176550d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.444455] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-6a57330a-ae8c-45e6-9517-7122b176550d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.444757] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a57330a-ae8c-45e6-9517-7122b176550d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.586869] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.586869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.586869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.586869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.586869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.587125] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.587125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.587206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.587300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.587373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.587457] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3e6206b-217a-495f-93c5-643d3576e725 already deleted. [ 985.588031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.711039] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cad1a85-e250-44ba-929f-39b2137bd736 in Status: SUCCESS [ 985.711237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.711413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.711682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.711876] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.711997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.712094] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.712240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.712321] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.712405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.712495] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.948473] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.948473] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.948683] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.948786] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.948933] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.949111] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 6a57330a-ae8c-45e6-9517-7122b176550d not found, creating... [ 985.949365] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.949517] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.949631] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.949854] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.949988] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.950285] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.950452] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.950548] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.950756] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.950887] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.951159] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 6a57330a-ae8c-45e6-9517-7122b176550d is going to be created. [ 985.972041] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.972307] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.972449] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.972740] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.972984] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.973302] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-6a57330a-ae8c-45e6-9517-7122b176550d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.097681] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 986.097681] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c deletion is rescheduled due to dependency. [ 986.097681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.207483] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 986.207677] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 986.207845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.214452] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.701016] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 986.701376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.701555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.701791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.701991] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.702119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.702181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.702337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.702440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.702529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.702691] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.702782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.702847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.702987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.703233] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.703346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.703395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.703521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.703591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.703671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.703754] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.711909] env[65678]: INFO networking_nsxv3.common.synchronization [req-88f61546-80be-459e-a122-9ecd0e52a80a req-b96adde5-b56b-4a93-9c40-ae6f51ba31e2 service nova] Enqueued Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_rules [ 986.711909] env[65678]: INFO networking_nsxv3.common.synchronization [req-88f61546-80be-459e-a122-9ecd0e52a80a req-b96adde5-b56b-4a93-9c40-ae6f51ba31e2 service nova] Enqueued Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_members [ 986.711909] env[65678]: INFO networking_nsxv3.common.synchronization [req-88f61546-80be-459e-a122-9ecd0e52a80a req-b96adde5-b56b-4a93-9c40-ae6f51ba31e2 service nova] Enqueued Resource ID: 6a57330a-ae8c-45e6-9517-7122b176550d with Priority: HIGHEST for action port [ 986.712288] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_rules [ 986.712336] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_members [ 986.712439] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a57330a-ae8c-45e6-9517-7122b176550d with Priority: HIGHEST for action port [ 986.713459] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.713538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.713634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.713838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.713890] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.715100] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.715100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.715100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.715290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.715290] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.715422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.715473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.715951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.715951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.715951] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.716639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a57330a-ae8c-45e6-9517-7122b176550d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.716756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a57330a-ae8c-45e6-9517-7122b176550d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.716826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a57330a-ae8c-45e6-9517-7122b176550d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.717235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a57330a-ae8c-45e6-9517-7122b176550d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.722916] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a57330a-ae8c-45e6-9517-7122b176550d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.723373] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cad1a85-e250-44ba-929f-39b2137bd736: rpc.has_security_group_logging(os_id): False [ 986.748136] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.748136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.748136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.748308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.748308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.749127] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.749127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.749127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.749127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.749127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.749127] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cad1a85-e250-44ba-929f-39b2137bd736 is going to be created. [ 986.815552] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.815552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.815552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.815552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.815552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.827485] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cad1a85-e250-44ba-929f-39b2137bd736 in Status: IN_PROGRESS for 2s [ 987.208491] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f236cc9-1bc2-44e5-b39b-04c5909837a7: rpc.has_security_group_logging(os_id): False [ 987.223539] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.223708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.223931] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.227712] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.227794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.228553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.228553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.228553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.228553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.228553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.228553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.228961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.228961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.228961] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.229972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.229972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.230202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.230389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.230550] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.230622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.230689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.231042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.231042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.231042] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be created. [ 987.232303] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a57330a-ae8c-45e6-9517-7122b176550d with status ACTIVE [ 987.232624] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.232624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.232795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.232795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.232852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.233040] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.233158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.233225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.233369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.233444] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.233624] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.233716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.233814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.233913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.233985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.234082] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a57330a-ae8c-45e6-9517-7122b176550d is going to be updated. [ 987.257380] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.257525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.257594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.257801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.257932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.258114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a57330a-ae8c-45e6-9517-7122b176550d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.295813] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.295975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.296052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.296647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.296647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.315902] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 987.727016] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.230066] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.230238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.230301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.230524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.230685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.230801] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3e6206b-217a-495f-93c5-643d3576e725 is going to be created. [ 988.258493] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.258683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.258730] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.258960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.259167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.269333] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3e6206b-217a-495f-93c5-643d3576e725 in Status: UNINITIALIZED for 2s [ 988.878624] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cad1a85-e250-44ba-929f-39b2137bd736 in Status: SUCCESS [ 988.878624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.330707] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 989.330707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.330707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.330707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.330707] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.765633] env[65678]: INFO networking_nsxv3.common.synchronization [None req-967f6c6e-ff28-4b17-b9ec-92cb87b48911 tempest-AttachVolumeShelveTestJSON-1282061189 tempest-AttachVolumeShelveTestJSON-1282061189-project-member] Enqueued Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_rules [ 989.766070] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_rules [ 989.766974] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.766974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.766974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.766974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.767258] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.832846] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.833040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.833453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.833453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.833543] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.833639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.833734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.833862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.833956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.834027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.834160] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.857879] env[65678]: INFO networking_nsxv3.common.synchronization [None req-91170ab8-2754-424f-ad81-50ea4211bd6e tempest-AttachVolumeShelveTestJSON-1282061189 tempest-AttachVolumeShelveTestJSON-1282061189-project-member] Enqueued Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_rules [ 989.858428] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_rules [ 989.858748] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.858876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.279748] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3e6206b-217a-495f-93c5-643d3576e725 in Status: SUCCESS [ 990.280136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.280204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.280384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.280750] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.280750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.280750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.280869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.281090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.281090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.281225] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.290310] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.290586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.290631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.291070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.291070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.291242] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b06f75c-4a15-46fd-8850-579c633c71af already deleted. [ 990.291336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.291438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.291603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.291691] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.336237] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.336487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.336609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.336832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.337118] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.337237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.337297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.337528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.337627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.337779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.337961] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.338070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.338130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.338271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.338412] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.338576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.338668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.338831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.338906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.339009] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.339169] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.783085] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.814179] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.814481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.814571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.814779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.814890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.815016] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b06f75c-4a15-46fd-8850-579c633c71af already deleted. [ 990.815154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.841481] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f236cc9-1bc2-44e5-b39b-04c5909837a7: rpc.has_security_group_logging(os_id): False [ 990.859478] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.859637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.859756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.860148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.860346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.860725] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.860829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.860962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.861043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.861134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.861401] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.861518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.861554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.861686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.861773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.861949] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.862062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.862125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.862397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.862494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.862599] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 990.925284] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.925519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.925519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.925772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.925932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.939122] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 991.285540] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3e6206b-217a-495f-93c5-643d3576e725: rpc.has_security_group_logging(os_id): False [ 991.303937] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.303937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.303937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.303937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.303937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.304403] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.304543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.304635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.304838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.304952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.305059] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3e6206b-217a-495f-93c5-643d3576e725 is going to be created. [ 991.373585] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.373721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.373721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.374181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.374181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.386421] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3e6206b-217a-495f-93c5-643d3576e725 in Status: IN_PROGRESS for 2s [ 991.639837] env[65678]: INFO networking_nsxv3.common.synchronization [req-fbc65596-b3f7-4d46-aa96-1f0521bb52dd req-d3489a6d-b744-4fd9-a6ad-614e28f6deb6 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 991.640706] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 991.643337] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.643337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.643337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.643337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.643337] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.643337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.643337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.643337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.643337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.643337] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.074770] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.074977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.075118] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.075387] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.075643] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.075791] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.075906] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.076264] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.076391] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.076609] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.076721] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.076848] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.076965] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.077092] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.077535] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.077686] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.096963] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.097153] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.097307] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.097498] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.097825] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.098082] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.098177] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.098523] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.098623] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.146531] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.146531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.146705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.147080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.147080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.147175] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.147274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.147344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.147517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.147553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.147638] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b already deleted. [ 992.147717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.601823] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.602195] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.602195] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.602496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.602850] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.602850] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd not found, creating... [ 992.603363] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.603555] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.603684] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.603923] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.604085] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.604404] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.604545] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.604670] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.604893] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.605050] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.605185] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd is going to be created. [ 992.626847] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.627084] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.627216] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.627501] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.627723] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.627947] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.952627] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 992.952913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.344498] env[65678]: INFO networking_nsxv3.common.synchronization [req-fbc65596-b3f7-4d46-aa96-1f0521bb52dd req-702d777e-4020-4546-a782-ca98a51961d6 service nova] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_rules [ 993.348153] env[65678]: INFO networking_nsxv3.common.synchronization [req-fbc65596-b3f7-4d46-aa96-1f0521bb52dd req-702d777e-4020-4546-a782-ca98a51961d6 service nova] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 993.348153] env[65678]: INFO networking_nsxv3.common.synchronization [req-fbc65596-b3f7-4d46-aa96-1f0521bb52dd req-702d777e-4020-4546-a782-ca98a51961d6 service nova] Enqueued Resource ID: a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd with Priority: HIGHEST for action port [ 993.348153] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_rules [ 993.348153] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 993.348153] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd with Priority: HIGHEST for action port [ 993.348153] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.348153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.348153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.348153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.348153] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.349175] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.349324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.349390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.349985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.350212] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.350999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.350999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.351276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.351628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.351740] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.352752] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.352884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.352941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.353194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.353370] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.412489] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3e6206b-217a-495f-93c5-643d3576e725 in Status: SUCCESS [ 993.412489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.855867] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.856327] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.856451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.856609] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd with status ACTIVE [ 993.856766] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.856997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.857095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.857321] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.857435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.857642] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.857724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.857795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.858323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.858323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.858425] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.858559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.858624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.858772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.858849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.858935] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd is going to be updated. [ 993.883314] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.883480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.883480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.883685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.883819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.883992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1c6ab08-b9ea-4b01-a18a-4c2b34cc49dd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.360771] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.863572] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.863987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.863987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.864083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.864175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.864294] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b is going to be created. [ 994.888742] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.888965] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.889060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.889275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.889452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.901192] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: UNINITIALIZED for 2s [ 996.835187] env[65678]: INFO networking_nsxv3.common.synchronization [req-88fc92d3-fda8-4054-af19-63683aed1922 req-ed799c3d-b46f-4528-bfd1-c22a207f2db2 tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_members [ 996.837211] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGHEST for action security_group_members [ 996.837211] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2de4eec-43fc-4180-be46-e291d4587236 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.837211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.837211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.837211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.837211] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.837211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.837211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.837211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.837211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.838495] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.915813] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: SUCCESS [ 996.916186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.916463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.916939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.917056] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.917261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.917378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.917600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.917709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.917827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.917943] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.340223] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.341941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.346105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.346105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.346105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.346105] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.346105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.346105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.346105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.346105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.346105] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2de4eec-43fc-4180-be46-e291d4587236 is going to be updated. [ 997.378292] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.378455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.378600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.378809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.378950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.390951] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2de4eec-43fc-4180-be46-e291d4587236 in Status: IN_PROGRESS for 2s [ 997.422671] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.926360] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9687b7d1-a464-4878-ae3a-b131f314c98b: rpc.has_security_group_logging(os_id): False [ 997.952930] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.952930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.952930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.952930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.952930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.952930] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.952930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.952930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.952930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.952930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.952930] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b is going to be created. [ 998.024672] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.024986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.024986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.025230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.025550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.046405] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: IN_PROGRESS for 2s [ 999.402189] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2de4eec-43fc-4180-be46-e291d4587236 in Status: SUCCESS [ 999.402543] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2de4eec-43fc-4180-be46-e291d4587236 deletion is rescheduled due to dependency. [ 999.402543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.063893] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: SUCCESS [ 1000.063893] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.837591] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1001.837925] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1004.011436] env[65678]: INFO networking_nsxv3.common.synchronization [req-2db60931-dc34-4c6c-be50-147a2a6a80d6 req-3e6014c0-5940-42fb-b780-4443a77039ce tempest-ServersV294TestFqdnHostnames-1719257474 tempest-ServersV294TestFqdnHostnames-1719257474-project-member] Enqueued Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_members [ 1004.012386] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGHEST for action security_group_members [ 1004.012639] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.012639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.012639] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.012860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.013067] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.013212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.013275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.014031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.014031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.014031] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.228112] env[65678]: INFO networking_nsxv3.common.synchronization [req-7ba66fe9-0ef2-489f-9ea4-2ecf8ff5c2d3 req-e3545b0a-5069-4252-a36a-aa4661dc31b2 tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 1004.228112] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 1004.228112] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.228112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.228112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.228424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.228679] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.229043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.229204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.229549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.229719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.229890] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.516705] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.516705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.516705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.517104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.517104] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.517896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.518300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.518386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.518588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.518676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.518779] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7f6218-60a3-4bd3-9819-6777964d3718 is going to be updated. [ 1004.548600] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.548751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.548858] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.549037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.549179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.560183] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7f6218-60a3-4bd3-9819-6777964d3718 in Status: IN_PROGRESS for 2s [ 1004.626952] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.627197] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.627335] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.627708] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.627978] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.628251] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.628412] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.628614] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.628761] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.628966] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.629091] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.629199] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.629330] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.629495] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.629622] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.629776] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.648622] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.648622] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.648772] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.648926] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.649336] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-d964e193-e879-40ce-bdb8-19d5653ae062 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.649336] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-d964e193-e879-40ce-bdb8-19d5653ae062" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.649452] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-d964e193-e879-40ce-bdb8-19d5653ae062" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.650035] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-d964e193-e879-40ce-bdb8-19d5653ae062" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.650035] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d964e193-e879-40ce-bdb8-19d5653ae062',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.732597] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.732900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.732900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.733336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.733495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.733743] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.733831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.733907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.734138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.734138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.734347] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 1004.767553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.767679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.767712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.767945] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.768133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.779482] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 1005.152440] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.152817] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.152817] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.153071] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.153337] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.153496] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port d964e193-e879-40ce-bdb8-19d5653ae062 not found, creating... [ 1005.153756] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.153911] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.154038] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.154268] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.154409] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.154709] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.154865] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.154989] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.155264] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.155412] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.155618] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: d964e193-e879-40ce-bdb8-19d5653ae062 is going to be created. [ 1005.176602] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.176602] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.176848] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.176959] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.177220] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.177438] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-d964e193-e879-40ce-bdb8-19d5653ae062" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.943303] env[65678]: INFO networking_nsxv3.common.synchronization [req-7ba66fe9-0ef2-489f-9ea4-2ecf8ff5c2d3 req-2c274ea5-0555-4d99-8171-8f0745bcdc28 service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 1005.943535] env[65678]: INFO networking_nsxv3.common.synchronization [req-7ba66fe9-0ef2-489f-9ea4-2ecf8ff5c2d3 req-2c274ea5-0555-4d99-8171-8f0745bcdc28 service nova] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 1005.943790] env[65678]: INFO networking_nsxv3.common.synchronization [req-7ba66fe9-0ef2-489f-9ea4-2ecf8ff5c2d3 req-2c274ea5-0555-4d99-8171-8f0745bcdc28 service nova] Enqueued Resource ID: d964e193-e879-40ce-bdb8-19d5653ae062 with Priority: HIGHEST for action port [ 1005.944420] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_rules [ 1005.944592] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 1005.945277] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d964e193-e879-40ce-bdb8-19d5653ae062 with Priority: HIGHEST for action port [ 1005.945277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.945277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.945277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.945607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.945607] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.946496] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.946617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.947260] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d964e193-e879-40ce-bdb8-19d5653ae062 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.947389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d964e193-e879-40ce-bdb8-19d5653ae062" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.947389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d964e193-e879-40ce-bdb8-19d5653ae062" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.947389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d964e193-e879-40ce-bdb8-19d5653ae062" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.947389] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d964e193-e879-40ce-bdb8-19d5653ae062',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.449532] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.449846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.449846] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d964e193-e879-40ce-bdb8-19d5653ae062 with status ACTIVE [ 1006.450019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.450149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.450218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.450428] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.450518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.450692] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.450924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.450924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.451048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.451176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.451409] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.451526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.451657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.451781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.451859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.451947] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d964e193-e879-40ce-bdb8-19d5653ae062 is going to be updated. [ 1006.474695] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.474841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.474911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.475138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.475277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.475441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d964e193-e879-40ce-bdb8-19d5653ae062" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.581603] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc7f6218-60a3-4bd3-9819-6777964d3718 in Status: SUCCESS [ 1006.581866] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc7f6218-60a3-4bd3-9819-6777964d3718 deletion is rescheduled due to dependency. [ 1006.583852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.792660] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 1006.793023] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c deletion is rescheduled due to dependency. [ 1006.793937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.794272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.794715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.794947] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.795307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.795459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.795717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.795957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.796162] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.298902] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.335204] env[65678]: INFO networking_nsxv3.common.synchronization [req-230b350f-2655-424a-82f7-29d5a26c39b5 req-41b65230-8c1f-4d5b-a287-86bf34c0a755 tempest-ServerRescueNegativeTestJSON-113281034 tempest-ServerRescueNegativeTestJSON-113281034-project-member] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 1007.335757] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 1007.336832] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.336832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.336832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.336832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.336832] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.336832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.336832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.337180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.337571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.337696] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.802016] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.824947] env[65678]: INFO networking_nsxv3.common.synchronization [None req-4990c486-6ccb-4a79-bb93-fe3d25e05fd1 None None] Enqueued Resource ID: 2bbde8b0-3d60-4f7f-bb78-693b819372d4 with Priority: HIGHEST for action port [ 1007.825509] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bbde8b0-3d60-4f7f-bb78-693b819372d4 with Priority: HIGHEST for action port [ 1007.825807] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bbde8b0-3d60-4f7f-bb78-693b819372d4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.825957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bbde8b0-3d60-4f7f-bb78-693b819372d4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.825998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bbde8b0-3d60-4f7f-bb78-693b819372d4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.827387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bbde8b0-3d60-4f7f-bb78-693b819372d4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.827505] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bbde8b0-3d60-4f7f-bb78-693b819372d4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.839812] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.305422] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.305422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.305422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.305628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.305781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.305846] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 1008.332025] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bbde8b0-3d60-4f7f-bb78-693b819372d4 [ 1008.332258] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.332382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.332450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.332667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.332795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.332859] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bbde8b0-3d60-4f7f-bb78-693b819372d4 already deleted. [ 1008.332992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bbde8b0-3d60-4f7f-bb78-693b819372d4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.338316] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.338467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.338705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.338759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.338880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.342585] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.348702] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 1008.849399] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.849399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.849399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.849399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.849399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.849399] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 is going to be updated. [ 1008.890040] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.890230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.890281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.890493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.890641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.902792] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: IN_PROGRESS for 2s [ 1010.256926] env[65678]: INFO networking_nsxv3.common.synchronization [req-4b2fb8b4-810a-420c-85c8-5ea2aafa72c7 req-a794737d-f09f-4595-9cfd-31570bba0ea9 tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 1010.257496] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 1010.257804] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.257934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.258013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.258211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.258366] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.258462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.258525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.258672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.258753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.258847] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.359374] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 1010.359595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.359763] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.360038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.360312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.360461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.360530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.360696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.360778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.360951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.360951] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.608840] env[65678]: INFO networking_nsxv3.common.synchronization [None req-f371b293-59f3-4247-8128-9476f1a8a454 None None] Enqueued Resource ID: 3c5e4af1-bdce-47d7-bbd2-e0502af1f204 with Priority: HIGHEST for action port [ 1010.609791] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c5e4af1-bdce-47d7-bbd2-e0502af1f204 with Priority: HIGHEST for action port [ 1010.609791] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c5e4af1-bdce-47d7-bbd2-e0502af1f204 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.609791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c5e4af1-bdce-47d7-bbd2-e0502af1f204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.610184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c5e4af1-bdce-47d7-bbd2-e0502af1f204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.612574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c5e4af1-bdce-47d7-bbd2-e0502af1f204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.612574] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c5e4af1-bdce-47d7-bbd2-e0502af1f204',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.760569] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.760837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.760978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.761333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.761506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.761822] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.761954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.762049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.762247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.762355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.762457] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 1010.793086] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.793334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.793438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.793657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.793802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.802370] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 1010.863132] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.863132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.863451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.863451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.863610] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.863710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.863768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.863922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.864017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.864107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.864389] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.864486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.864528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.864681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.864823] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.864915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.864977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.865130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.865204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.865285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.865374] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.913551] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: SUCCESS [ 1010.913728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.113034] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c5e4af1-bdce-47d7-bbd2-e0502af1f204 [ 1011.113257] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.113401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.113473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.113697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.114308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.114308] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c5e4af1-bdce-47d7-bbd2-e0502af1f204 already deleted. [ 1011.114308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c5e4af1-bdce-47d7-bbd2-e0502af1f204" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.370196] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c: rpc.has_security_group_logging(os_id): False [ 1011.391602] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.391862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.391862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.392096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.392155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.392350] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.392508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.392508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.392657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.392746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.392947] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.393064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.393187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.393344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.393426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.393625] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.393727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.393782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.393911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.393985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.394084] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 1011.467238] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.467394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.467466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.467682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.467828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.492036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 1012.812521] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 1012.812911] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d deletion is rescheduled due to dependency. [ 1012.812911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.509917] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 1013.510184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.610328] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1015.610758] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1016.244576] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d114b6f-ee13-4200-99ed-39fc18d36d2c req-60b05793-0067-4d46-991c-99d439a5f2e9 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1016.245196] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1016.245532] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.245677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.245752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.245962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.246161] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.246272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.246354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.246527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.246631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.246727] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.540452] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.540641] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.540775] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.541100] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.541361] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.541518] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.541633] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.541856] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.541993] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.542221] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.542364] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.542516] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.542644] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.542760] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1016.542864] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.542993] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.564277] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.564475] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1016.564668] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.564859] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.565182] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-4d182acf-7761-439b-a77f-31a7f7a85fce taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.565352] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-4d182acf-7761-439b-a77f-31a7f7a85fce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.565470] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-4d182acf-7761-439b-a77f-31a7f7a85fce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.565787] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-4d182acf-7761-439b-a77f-31a7f7a85fce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.565925] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d182acf-7761-439b-a77f-31a7f7a85fce',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.748990] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.069692] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.069692] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.069692] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.069692] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.069692] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.069692] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 4d182acf-7761-439b-a77f-31a7f7a85fce not found, creating... [ 1017.070068] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.070068] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.070172] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.070385] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.070521] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.070794] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.070964] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.071113] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.071368] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.071506] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.071642] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 4d182acf-7761-439b-a77f-31a7f7a85fce is going to be created. [ 1017.093071] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.093399] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.093526] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.093784] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.094009] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.094274] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-4d182acf-7761-439b-a77f-31a7f7a85fce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.252580] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.755610] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.755885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.755885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.756095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.756196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.756300] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1017.785277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.785478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.785560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.785775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.785983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.796942] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1017.806589] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d114b6f-ee13-4200-99ed-39fc18d36d2c req-e1f75f45-fcf7-433b-9d2e-b1c5a5301f85 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1017.806589] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d114b6f-ee13-4200-99ed-39fc18d36d2c req-e1f75f45-fcf7-433b-9d2e-b1c5a5301f85 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1017.806668] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d114b6f-ee13-4200-99ed-39fc18d36d2c req-e1f75f45-fcf7-433b-9d2e-b1c5a5301f85 service nova] Enqueued Resource ID: 4d182acf-7761-439b-a77f-31a7f7a85fce with Priority: HIGHEST for action port [ 1017.809960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1017.809960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1017.809960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d182acf-7761-439b-a77f-31a7f7a85fce with Priority: HIGHEST for action port [ 1017.809960] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.809960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.809960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.809960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.809960] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.809960] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.809960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.809960] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d182acf-7761-439b-a77f-31a7f7a85fce taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.809960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d182acf-7761-439b-a77f-31a7f7a85fce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.809960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d182acf-7761-439b-a77f-31a7f7a85fce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.809960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d182acf-7761-439b-a77f-31a7f7a85fce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.809960] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d182acf-7761-439b-a77f-31a7f7a85fce',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.311705] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.311920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.311980] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d182acf-7761-439b-a77f-31a7f7a85fce with status ACTIVE [ 1018.312147] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.312257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.312320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.312545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.312805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.312943] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.313061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.313127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.313367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.313501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.313701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.313796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.313859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.314013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.314091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.314195] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d182acf-7761-439b-a77f-31a7f7a85fce is going to be updated. [ 1018.342182] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.342372] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.342425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.342631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.342819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.343023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d182acf-7761-439b-a77f-31a7f7a85fce" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.633423] env[65678]: INFO networking_nsxv3.common.synchronization [req-6c8286c3-1d60-461a-b6f1-a44de1d296aa req-87c6851d-3998-4d83-8cb7-649a462181ea tempest-ServersAdminTestJSON-1252313613 tempest-ServersAdminTestJSON-1252313613-project-member] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1018.634368] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1018.634734] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.634874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.634968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.635189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.635346] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.635448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.635530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.635695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.635803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.635905] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.740171] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1018.740318] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent loop - iteration:2 started [ 1018.984150] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.984150] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.984150] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.984150] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.985701] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.986370] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.986906] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.987334] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.987631] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.988075] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.988324] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.990018] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.990018] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.990018] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.990018] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.990018] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.039021] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.039021] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1019.039977] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.039977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.039977] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-652c9f91-56df-440e-93ab-6e78ac282183 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.039977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-652c9f91-56df-440e-93ab-6e78ac282183" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.039977] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-652c9f91-56df-440e-93ab-6e78ac282183" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.040292] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-652c9f91-56df-440e-93ab-6e78ac282183" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.040433] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('652c9f91-56df-440e-93ab-6e78ac282183',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.137900] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.543843] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.544295] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.544295] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.544508] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.544656] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.544804] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 652c9f91-56df-440e-93ab-6e78ac282183 not found, creating... [ 1019.545060] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.545215] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.545329] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.545547] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.545682] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.545950] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.546113] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.546226] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.546529] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.546666] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.546797] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 652c9f91-56df-440e-93ab-6e78ac282183 is going to be created. [ 1019.566298] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.566530] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.566593] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.566847] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.567082] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.567303] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-652c9f91-56df-440e-93ab-6e78ac282183" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.641323] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.809049] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1019.809049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.809049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.809049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.809049] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.809049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.809049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.809049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.809049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.809732] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.143702] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.144056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.144056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.145021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.145159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.145274] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1020.175902] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.176066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.176066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.176250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.176425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.186846] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1020.274744] env[65678]: INFO networking_nsxv3.common.synchronization [req-6c8286c3-1d60-461a-b6f1-a44de1d296aa req-e4d7c32b-32cf-44d5-9e58-c30e8c3d69b5 service nova] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_rules [ 1020.274893] env[65678]: INFO networking_nsxv3.common.synchronization [req-6c8286c3-1d60-461a-b6f1-a44de1d296aa req-e4d7c32b-32cf-44d5-9e58-c30e8c3d69b5 service nova] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1020.275077] env[65678]: INFO networking_nsxv3.common.synchronization [req-6c8286c3-1d60-461a-b6f1-a44de1d296aa req-e4d7c32b-32cf-44d5-9e58-c30e8c3d69b5 service nova] Enqueued Resource ID: 652c9f91-56df-440e-93ab-6e78ac282183 with Priority: HIGHEST for action port [ 1020.276417] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_rules [ 1020.276643] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1020.276780] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 652c9f91-56df-440e-93ab-6e78ac282183 with Priority: HIGHEST for action port [ 1020.277108] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.277272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.277354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.277701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.277811] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.278707] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.278811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.279015] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-652c9f91-56df-440e-93ab-6e78ac282183 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.279123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-652c9f91-56df-440e-93ab-6e78ac282183" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.279192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-652c9f91-56df-440e-93ab-6e78ac282183" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.279379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-652c9f91-56df-440e-93ab-6e78ac282183" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.279458] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('652c9f91-56df-440e-93ab-6e78ac282183',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.311132] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.781387] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.781653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.781824] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 652c9f91-56df-440e-93ab-6e78ac282183 with status ACTIVE [ 1020.781970] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.782159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.782290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.782545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.782669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.782870] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.783018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.783114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.783336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.783447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.783724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.783863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.783948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.784147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.784276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.784419] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 652c9f91-56df-440e-93ab-6e78ac282183 is going to be updated. [ 1020.805591] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.805785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.805847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.806115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.806299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.806488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-652c9f91-56df-440e-93ab-6e78ac282183" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.814130] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.216859] env[65678]: INFO networking_nsxv3.common.synchronization [req-771be56c-b6eb-45d0-b2f3-ff59f3053f4f req-430389b5-f531-4bb8-90ea-021874cf1a7a tempest-AttachVolumeShelveTestJSON-1282061189 tempest-AttachVolumeShelveTestJSON-1282061189-project-member] Enqueued Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_members [ 1021.217462] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_members [ 1021.217783] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.217905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.217984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.218246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.218405] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.218504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.218567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.218717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.218801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.218914] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.316431] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.316751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.316751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.316909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.316966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.317078] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1021.349604] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.349805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.349855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.350493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.350493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.360475] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1021.538948] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-544 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.539226] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.539368] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.539685] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.540042] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.540241] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.540362] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.540593] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.540753] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.540992] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.541138] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.541710] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.541710] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.541710] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.541710] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.541993] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.565965] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.565965] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.565965] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.565965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.565965] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-648de54a-548a-4832-baa5-1b119645747e taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.565965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.565965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.565965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.565965] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('648de54a-548a-4832-baa5-1b119645747e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.721359] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.721521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.721585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.721807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.721895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.722107] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.722383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.722469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.722620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.722699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.722840] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b06f75c-4a15-46fd-8850-579c633c71af already deleted. [ 1021.722885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.069028] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.069338] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.069472] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.069744] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.069889] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.070061] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 648de54a-548a-4832-baa5-1b119645747e not found, creating... [ 1022.070375] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.070545] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.070774] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.070914] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.070998] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.071404] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.071569] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.071684] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.071907] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.072053] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.072728] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 648de54a-548a-4832-baa5-1b119645747e is going to be created. [ 1022.095047] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.095276] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.095600] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.095600] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.095895] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.096162] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.205562] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1022.205829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.205988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.206245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.206435] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.206555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.206623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.206777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.206857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.206954] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.710496] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.810824] env[65678]: INFO networking_nsxv3.common.synchronization [req-771be56c-b6eb-45d0-b2f3-ff59f3053f4f req-ad0143a4-2474-4b25-97eb-730cde49edc4 service nova] Enqueued Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_rules [ 1022.810824] env[65678]: INFO networking_nsxv3.common.synchronization [req-771be56c-b6eb-45d0-b2f3-ff59f3053f4f req-ad0143a4-2474-4b25-97eb-730cde49edc4 service nova] Enqueued Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_members [ 1022.810824] env[65678]: INFO networking_nsxv3.common.synchronization [req-771be56c-b6eb-45d0-b2f3-ff59f3053f4f req-ad0143a4-2474-4b25-97eb-730cde49edc4 service nova] Enqueued Resource ID: 648de54a-548a-4832-baa5-1b119645747e with Priority: HIGHEST for action port [ 1022.810824] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_rules [ 1022.810824] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_members [ 1022.812782] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 648de54a-548a-4832-baa5-1b119645747e with Priority: HIGHEST for action port [ 1022.812782] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.813463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.813463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.813725] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.813780] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.815658] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.815658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.815658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.815658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.815658] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.816241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.816241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.816241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.816241] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.816241] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.819439] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-648de54a-548a-4832-baa5-1b119645747e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.819439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.819439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.821219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.821219] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('648de54a-548a-4832-baa5-1b119645747e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.214454] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.316312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.316500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.322164] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.323087] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 648de54a-548a-4832-baa5-1b119645747e with status ACTIVE [ 1023.323438] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.323438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.323588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.324542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.324542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.324542] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.324542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.324542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.324542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.324542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.324542] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.324872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.324872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.324872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.324975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.325024] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 648de54a-548a-4832-baa5-1b119645747e is going to be updated. [ 1023.350440] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.350577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.350577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.350796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.350934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.351111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.371414] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1023.372230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.373434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.373668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.373868] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.373988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.374071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.374260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.374355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.374473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.374570] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.717063] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.717382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.717425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.717732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.717903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.718247] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1023.754798] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.754960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.755044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.755258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.755896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.765075] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1023.828721] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.880190] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.880388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.880487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.880747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.881016] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.881366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.881366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.881540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.881661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.881808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.882018] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.882146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.882216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.882367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.882962] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.882962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.882962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.883154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.883251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.883323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.883417] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.332553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.333610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.333610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.333610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.333610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.333610] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b06f75c-4a15-46fd-8850-579c633c71af is going to be created. [ 1024.376307] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.376442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.376496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.376679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.376835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.386824] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79cab93f-aae5-467c-88f3-35382c30a4ef: rpc.has_security_group_logging(os_id): False [ 1024.392595] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: UNINITIALIZED for 2s [ 1024.409397] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.409563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.409623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.409844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.409936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.410214] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.410322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.410410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.410598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.410683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.410900] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.411084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.411166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.411335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.411425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.411716] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.411870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.411976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.412209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.412341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.412502] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1024.487756] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.487928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.487977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.488214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.488357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.502067] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1025.392715] env[65678]: INFO networking_nsxv3.common.synchronization [req-e3bab064-8176-4d16-88af-7f1c3d36f2cf req-3247c8ff-f7da-4228-a532-4a8a07b9e562 tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_members [ 1025.393443] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGHEST for action security_group_members [ 1025.393758] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3b380ca-ae52-4449-89ca-b2e647b635d9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.393904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.393988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.394273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.394452] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.394588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.394588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.394876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.394876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.394876] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3b380ca-ae52-4449-89ca-b2e647b635d9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.778036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1025.778036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.778036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.778036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.778036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.778036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.778036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.778036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.778036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.778036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.778036] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.896711] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.899744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.899744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.899744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.899744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.899744] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.899744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.899744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.899744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.899744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.899744] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 is going to be updated. [ 1025.936224] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.936224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.936224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.936224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.936224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.946138] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 in Status: IN_PROGRESS for 2s [ 1026.280216] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.280373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.280630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.280630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.280764] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.280860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.280919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.281087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.281192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.281290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.281439] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.281602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.281602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.281726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.282097] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.282097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.282097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.282266] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.282266] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.282340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.282375] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.283985] env[65678]: INFO networking_nsxv3.common.synchronization [req-e1c0d73d-efdf-4c4a-8d25-837ad9efbaca req-fa23a990-31ce-44e5-bfac-130c1b93fe00 tempest-ImagesTestJSON-1633842006 tempest-ImagesTestJSON-1633842006-project-member] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 1026.284877] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGHEST for action security_group_members [ 1026.285170] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.285330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.285330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.285524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.285628] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.285711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.285774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.285907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.285982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.286080] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.403319] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: SUCCESS [ 1026.403319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.403319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.403319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.403319] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.403319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.403319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.403319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.403319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.403319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.403319] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.519265] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1026.519512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.787635] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f236cc9-1bc2-44e5-b39b-04c5909837a7: rpc.has_security_group_logging(os_id): False [ 1026.788914] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.789072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.789143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.789348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.789439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.789623] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.789725] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.789817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.790017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.790102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.790191] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be updated. [ 1026.807426] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.807426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.807570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.807685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.807772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.807993] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.808114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.808254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.808437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.808522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.808713] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.808809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.808871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.809016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.809386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.809386] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.809386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.809605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.809645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.809714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.809802] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1026.821741] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.821926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.821977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.822177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.822314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.831269] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: IN_PROGRESS for 2s [ 1026.872257] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.872399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.872458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.872666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.872809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.888310] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1026.905877] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.408854] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b06f75c-4a15-46fd-8850-579c633c71af: rpc.has_security_group_logging(os_id): False [ 1027.427871] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.428061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.428110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.428339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.428508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.428858] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.429026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.429069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.429244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.429378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.429585] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b06f75c-4a15-46fd-8850-579c633c71af is going to be created. [ 1027.494997] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.495279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.495279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.495443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.495615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.508561] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: IN_PROGRESS for 2s [ 1027.955897] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 in Status: SUCCESS [ 1027.956094] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 deletion is rescheduled due to dependency. [ 1027.956234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3b380ca-ae52-4449-89ca-b2e647b635d9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.842209] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c in Status: SUCCESS [ 1028.842209] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c deletion is rescheduled due to dependency. [ 1028.842209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.905286] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1028.905443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.185814] env[65678]: INFO networking_nsxv3.common.synchronization [req-9508dd76-7c4d-48ca-b7d2-8e74a277c1d7 req-58f9ff5b-36c6-44b6-aeca-e88e1f87b394 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 1029.186431] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 1029.187028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.187130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.187215] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.187400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.187558] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.187924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.187924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.187924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.187924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.188101] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.502946] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.502946] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.502946] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.503208] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.503426] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.503595] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.503714] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.503940] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.504103] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.504319] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.504453] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.504576] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.504746] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.504792] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.505335] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.505335] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.524257] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: SUCCESS [ 1029.524614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.529897] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.530171] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.530419] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.530699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.531234] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.531586] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.531815] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.532273] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.532475] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a4affd-bd26-4c19-bd7b-8b225ae06d34',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.690065] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.035853] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.036282] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.036282] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.036549] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.036777] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.037050] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port d0a4affd-bd26-4c19-bd7b-8b225ae06d34 not found, creating... [ 1030.037470] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.037748] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.037946] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.038429] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.038536] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.039017] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.039526] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.039711] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.040132] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.040359] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.040577] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: d0a4affd-bd26-4c19-bd7b-8b225ae06d34 is going to be created. [ 1030.063586] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.063844] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.063926] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.064234] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.064519] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.064784] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.081765] env[65678]: INFO networking_nsxv3.common.synchronization [req-04a0a881-21e1-4f50-9019-69eef61d14cf req-8bda7a13-109f-4ca2-93d7-74b5bb6f1780 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1030.082196] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1030.082573] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.082715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.082787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.082995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.083199] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.083365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.083438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.083601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.083713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.083812] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.192179] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.587757] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.694784] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.695014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.695014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.695245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.695338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.695440] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b is going to be updated. [ 1030.726731] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.726884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.726955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.727198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.727345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.737978] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: IN_PROGRESS for 2s [ 1030.804203] env[65678]: INFO networking_nsxv3.common.synchronization [req-9508dd76-7c4d-48ca-b7d2-8e74a277c1d7 req-d6451710-4192-4fc9-a887-a497ce035b8a service nova] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_rules [ 1030.804203] env[65678]: INFO networking_nsxv3.common.synchronization [req-9508dd76-7c4d-48ca-b7d2-8e74a277c1d7 req-d6451710-4192-4fc9-a887-a497ce035b8a service nova] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 1030.804384] env[65678]: INFO networking_nsxv3.common.synchronization [req-9508dd76-7c4d-48ca-b7d2-8e74a277c1d7 req-d6451710-4192-4fc9-a887-a497ce035b8a service nova] Enqueued Resource ID: d0a4affd-bd26-4c19-bd7b-8b225ae06d34 with Priority: HIGHEST for action port [ 1030.804826] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_rules [ 1030.805030] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 1030.805097] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a4affd-bd26-4c19-bd7b-8b225ae06d34 with Priority: HIGHEST for action port [ 1030.805344] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.805454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.805516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.805748] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.805829] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.806688] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.806801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.806964] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.807084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.807142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.807305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.807826] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a4affd-bd26-4c19-bd7b-8b225ae06d34',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.090200] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.310870] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.310870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.310870] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0a4affd-bd26-4c19-bd7b-8b225ae06d34 with status ACTIVE [ 1031.311165] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.311165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.311165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.311431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.311540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.311733] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.311834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.311925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.312101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.312177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.312358] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.312453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.312517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.312654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.312726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.312809] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0a4affd-bd26-4c19-bd7b-8b225ae06d34 is going to be updated. [ 1031.349661] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.349850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.349850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.350097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.350246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.350416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0a4affd-bd26-4c19-bd7b-8b225ae06d34" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.594202] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.594202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.594202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.594202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.594202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.594202] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1031.636255] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.636255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.636255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.636255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.636446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.646824] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1032.750391] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: SUCCESS [ 1032.750717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.755589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.755589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.755589] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.755589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.755589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.755589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.755589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.755589] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.257601] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.658136] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1033.658136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.761802] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.265196] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.265356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.265425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.265666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.265771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.265879] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b is going to be updated. [ 1034.299254] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.299386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.299456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.299782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.299928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.309761] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: IN_PROGRESS for 2s [ 1035.190620] env[65678]: INFO networking_nsxv3.common.synchronization [req-1fbc56b4-84f5-4e5d-a11f-590b5eda7c65 req-41c83553-e2a3-4615-bb18-c7549bd569c4 tempest-ServerRescueNegativeTestJSON-113281034 tempest-ServerRescueNegativeTestJSON-113281034-project-member] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 1035.192106] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGHEST for action security_group_members [ 1035.192459] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.192776] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.192857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.193080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.193239] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.193339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.193399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.193614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.193728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.193827] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.695672] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.695852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.695927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.696182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.696279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.696484] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.696586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.696650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.696807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.696887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.696974] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 is going to be updated. [ 1035.728326] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.728500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.728543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.728745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.728886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.738262] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: IN_PROGRESS for 2s [ 1036.321615] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: SUCCESS [ 1036.321615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.321615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.321615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.321615] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.322171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.322171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.322171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.322171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.322296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.322392] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.668036] env[65678]: INFO networking_nsxv3.common.synchronization [req-bf4866b3-18ac-49a7-bc25-452b614f8b07 req-599025b8-58f5-4f71-bc1f-15f16a6cd62d tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 1036.668598] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 1036.668995] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.669164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.669232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.669427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.669583] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.669683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.669751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.669920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.670022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.670130] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.824666] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.172484] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.172669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.172738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.172959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.173143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.173359] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.173647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.173719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.173884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.173966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.174069] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 1037.201383] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.201551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.201599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.201799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.201933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.212246] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 1037.329849] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9687b7d1-a464-4878-ae3a-b131f314c98b: rpc.has_security_group_logging(os_id): False [ 1037.345992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.346217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.346288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.346446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.346542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.346791] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.346890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.346948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.347141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.347226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.347300] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b is going to be updated. [ 1037.425020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.425611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.425611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.425611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.425611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.439845] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: IN_PROGRESS for 2s [ 1037.466982] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.467209] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.467441] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.467590] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.467842] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.467997] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.468133] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.468372] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.468481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.468730] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.468847] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.468956] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.469078] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.469188] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.469292] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.469424] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.488967] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.489170] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.489357] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.489599] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-927" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.489960] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.490157] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.490285] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.490614] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.490762] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff0a90e6-a76d-4374-a8ed-6ec193d9cad0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.750488] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 in Status: SUCCESS [ 1037.750669] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 deletion is rescheduled due to dependency. [ 1037.750786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.994372] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.994746] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.994928] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.995304] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.995530] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.995694] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port ff0a90e6-a76d-4374-a8ed-6ec193d9cad0 not found, creating... [ 1037.996038] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.996323] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.996477] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.996786] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.996970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.997352] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.997555] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.997707] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.997976] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.998153] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.998329] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: ff0a90e6-a76d-4374-a8ed-6ec193d9cad0 is going to be created. [ 1038.020453] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.020691] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.020797] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.021099] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.021326] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.021627] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.769821] env[65678]: INFO networking_nsxv3.common.synchronization [req-bf4866b3-18ac-49a7-bc25-452b614f8b07 req-c12d1887-57f4-439e-a574-21805fd1871e service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 1038.770130] env[65678]: INFO networking_nsxv3.common.synchronization [req-bf4866b3-18ac-49a7-bc25-452b614f8b07 req-c12d1887-57f4-439e-a574-21805fd1871e service nova] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 1038.770228] env[65678]: INFO networking_nsxv3.common.synchronization [req-bf4866b3-18ac-49a7-bc25-452b614f8b07 req-c12d1887-57f4-439e-a574-21805fd1871e service nova] Enqueued Resource ID: ff0a90e6-a76d-4374-a8ed-6ec193d9cad0 with Priority: HIGHEST for action port [ 1038.770742] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_rules [ 1038.770883] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 1038.770980] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff0a90e6-a76d-4374-a8ed-6ec193d9cad0 with Priority: HIGHEST for action port [ 1038.771299] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.771396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.771543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.771667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.771747] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.772672] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.772837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.772892] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.772979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.773061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.773291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.773291] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff0a90e6-a76d-4374-a8ed-6ec193d9cad0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.173032] env[65678]: INFO networking_nsxv3.common.synchronization [req-9471ad47-3402-42e5-a9da-e7d265960acf req-112f691c-7f87-4dbc-b411-a0f925314cba tempest-FloatingIPsAssociationNegativeTestJSON-1007333382 tempest-FloatingIPsAssociationNegativeTestJSON-1007333382-project-member] Enqueued Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGHEST for action security_group_members [ 1039.173853] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGHEST for action security_group_members [ 1039.174277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.174443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.174544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.174888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.175130] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.175277] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.175371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.175588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.175714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.175852] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.221575] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 4s [ 1039.275194] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.275325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.276669] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff0a90e6-a76d-4374-a8ed-6ec193d9cad0 with status ACTIVE [ 1039.276852] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.276966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.277045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.277265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.277357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.277591] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.277745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.277745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.277861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.277900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.278099] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.278194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.278254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.278397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.278470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.278554] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff0a90e6-a76d-4374-a8ed-6ec193d9cad0 is going to be updated. [ 1039.302960] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.303168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.303217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.303413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.303548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.303768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff0a90e6-a76d-4374-a8ed-6ec193d9cad0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.454826] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: SUCCESS [ 1039.455074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.482610] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.482812] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.483069] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.483322] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.483596] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.483792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.483890] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.484752] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.484752] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.484752] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.484752] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.484752] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.484961] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.484961] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.485118] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.485177] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.504356] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.504711] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1039.504711] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.504810] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.505217] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.505314] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.505429] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.505912] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.505912] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad34cc96-2daf-40a4-9e43-bf0c00d690ed',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.679039] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.679039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.679039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.679272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.679272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.679352] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.680022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.680022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.680022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.680022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.680022] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c already deleted. [ 1039.680022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.011724] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.011724] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.011724] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.012226] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.012226] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.012226] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port ad34cc96-2daf-40a4-9e43-bf0c00d690ed not found, creating... [ 1040.012460] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.012612] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.012724] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.012939] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.013103] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.013381] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.013531] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.013689] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.013900] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.014122] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.014274] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: ad34cc96-2daf-40a4-9e43-bf0c00d690ed is going to be created. [ 1040.037849] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.037849] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.037980] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.038234] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.041675] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.041675] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.778156] env[65678]: INFO networking_nsxv3.common.synchronization [req-9471ad47-3402-42e5-a9da-e7d265960acf req-e99a93d6-f780-49fd-9f9d-7a908ac0ec1e service nova] Enqueued Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGHEST for action security_group_rules [ 1040.778565] env[65678]: INFO networking_nsxv3.common.synchronization [req-9471ad47-3402-42e5-a9da-e7d265960acf req-e99a93d6-f780-49fd-9f9d-7a908ac0ec1e service nova] Enqueued Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGHEST for action security_group_members [ 1040.778680] env[65678]: INFO networking_nsxv3.common.synchronization [req-9471ad47-3402-42e5-a9da-e7d265960acf req-e99a93d6-f780-49fd-9f9d-7a908ac0ec1e service nova] Enqueued Resource ID: ad34cc96-2daf-40a4-9e43-bf0c00d690ed with Priority: HIGHEST for action port [ 1040.779299] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGHEST for action security_group_rules [ 1040.779436] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGHEST for action security_group_members [ 1040.779533] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad34cc96-2daf-40a4-9e43-bf0c00d690ed with Priority: HIGHEST for action port [ 1040.779804] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.779971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.780139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.780500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.780650] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.781638] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.781836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.782929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.783229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.783821] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.783821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.783821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.783821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.784419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.784419] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.785087] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.785993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.785993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.785993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.785993] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad34cc96-2daf-40a4-9e43-bf0c00d690ed',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.132368] env[65678]: INFO networking_nsxv3.common.synchronization [None req-f716af23-f33d-4edb-a7ea-5d6125c32fc3 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 1041.134044] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 1041.134044] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.134044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.134044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.134292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.134390] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.134489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.134548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.134880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.134988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.135310] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.233612] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 1041.233836] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d deletion is rescheduled due to dependency. [ 1041.233955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.234153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.234723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.234723] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.234723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.234723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.234966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.234966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.235075] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.288601] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.291923] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.291923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.291923] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad34cc96-2daf-40a4-9e43-bf0c00d690ed with status ACTIVE [ 1041.292167] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.292239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.292279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.292487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.292572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.292737] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.292841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.292937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.293069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.293147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.293329] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.293421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.293477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.293615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.293698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.293792] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad34cc96-2daf-40a4-9e43-bf0c00d690ed is going to be updated. [ 1041.317845] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.317998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.318253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.318502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.318631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.318896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad34cc96-2daf-40a4-9e43-bf0c00d690ed" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.528514] env[65678]: INFO networking_nsxv3.common.synchronization [req-536eb81c-585c-4b91-a674-1693e79c0345 req-519bbdab-91cc-4673-8878-c7bdb6afa62b tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1041.529009] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1041.530116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.530116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.530116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.530116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.530600] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.530600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.530717] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.530890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.531050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.531199] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.636966] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.637162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.637210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.637437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.637544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.637758] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.637993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.638105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.638316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.638433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.638529] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 1041.679700] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.679936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.680029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.680304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.680458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.694191] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 1041.741541] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.796106] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.895656] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.895918] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.896092] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.896424] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.896757] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.896937] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.897180] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.897434] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.897585] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.897793] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.897907] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.898070] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.898228] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.898350] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.898468] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.898611] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.934101] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.934326] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.934698] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.934838] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.935335] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-67ae5480-5c77-4c2e-82f6-baed4a4260c0 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.935505] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-67ae5480-5c77-4c2e-82f6-baed4a4260c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.935620] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-67ae5480-5c77-4c2e-82f6-baed4a4260c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.936290] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-67ae5480-5c77-4c2e-82f6-baed4a4260c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.936393] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ae5480-5c77-4c2e-82f6-baed4a4260c0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.034623] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.034623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.034623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.034623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.034939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.034939] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.035165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.035246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.035469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.035561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.035655] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1042.070600] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.070804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.070848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.071892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.071892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.082726] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1042.245405] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.299955] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.300100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.300191] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.300419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.300516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.300615] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c is going to be created. [ 1042.332816] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.333029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.333029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.333264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.333421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.347882] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c in Status: UNINITIALIZED for 2s [ 1042.439960] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.440358] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.440562] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.440901] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.441182] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.441404] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 67ae5480-5c77-4c2e-82f6-baed4a4260c0 not found, creating... [ 1042.441767] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.441995] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.442095] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.442402] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.442617] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.442954] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.443210] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.443411] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.443774] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.444041] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.444253] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 67ae5480-5c77-4c2e-82f6-baed4a4260c0 is going to be created. [ 1042.469863] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.470132] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.470262] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.470536] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.470831] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.471108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-67ae5480-5c77-4c2e-82f6-baed4a4260c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.747926] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.748109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.748246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.748509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.748644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.748741] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 1042.787706] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.788123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.788123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.788707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.788707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.797851] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 1043.159024] env[65678]: INFO networking_nsxv3.common.synchronization [req-536eb81c-585c-4b91-a674-1693e79c0345 req-7719d9fb-7ed7-42b0-9a12-db73737b5acd service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1043.159272] env[65678]: INFO networking_nsxv3.common.synchronization [req-536eb81c-585c-4b91-a674-1693e79c0345 req-7719d9fb-7ed7-42b0-9a12-db73737b5acd service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1043.159388] env[65678]: INFO networking_nsxv3.common.synchronization [req-536eb81c-585c-4b91-a674-1693e79c0345 req-7719d9fb-7ed7-42b0-9a12-db73737b5acd service nova] Enqueued Resource ID: 67ae5480-5c77-4c2e-82f6-baed4a4260c0 with Priority: HIGHEST for action port [ 1043.163398] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1043.163576] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1043.163678] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67ae5480-5c77-4c2e-82f6-baed4a4260c0 with Priority: HIGHEST for action port [ 1043.165979] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.165979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.165979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.165979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.166218] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.169978] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.169978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.169978] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-67ae5480-5c77-4c2e-82f6-baed4a4260c0 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.169978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67ae5480-5c77-4c2e-82f6-baed4a4260c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.169978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67ae5480-5c77-4c2e-82f6-baed4a4260c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.171041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67ae5480-5c77-4c2e-82f6-baed4a4260c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.171041] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67ae5480-5c77-4c2e-82f6-baed4a4260c0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.673246] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.673654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.673654] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67ae5480-5c77-4c2e-82f6-baed4a4260c0 with status ACTIVE [ 1043.673941] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.674058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.674120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.674364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.674459] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.674665] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.674808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.674847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.675070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.675070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.675277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.675383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.675447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.675610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.675678] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.676189] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67ae5480-5c77-4c2e-82f6-baed4a4260c0 is going to be updated. [ 1043.703715] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.704016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.704016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.704252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.704476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.704964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67ae5480-5c77-4c2e-82f6-baed4a4260c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.705611] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 1043.705796] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 deletion is rescheduled due to dependency. [ 1043.705896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.094693] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1044.094949] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1044.095120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.095345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.095983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.095983] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.095983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.095983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.096321] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.096370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.096463] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.358911] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c in Status: SUCCESS [ 1044.359430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.359430] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.359557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.359754] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.359988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.359988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.360210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.360300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.361039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.361039] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.598679] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.808800] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 1044.809048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.809239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.809533] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.809733] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.809852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.809920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.810091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.810234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.810331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.810452] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.862581] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.862741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.862797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.863013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.863185] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.863284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.863339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.863491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.863576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.863660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.863864] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.863952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.864042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.864187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.864326] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.864415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.864469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.864603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.864675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.864757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.865144] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.103667] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.313680] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.313680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.313680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.313680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.313680] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.314228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.314228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.314228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.314228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.314228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.314499] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.314499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.314499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.314670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.314883] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.314883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.314883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.315085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.315157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.315831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.315831] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.367267] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d205434-5ee2-4e1a-bee3-e65c424f311c: rpc.has_security_group_logging(os_id): False [ 1045.386261] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.386436] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.386493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.386679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.386769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.387675] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.387675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.387675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.387675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.387675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.387675] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.387675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.387675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.388167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.388167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.388167] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.388287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.388325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.388443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.388512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.388597] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c is going to be created. [ 1045.466037] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.466037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.466037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.466474] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.466474] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.480314] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c in Status: IN_PROGRESS for 2s [ 1045.606589] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.606781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.606824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.607050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.607151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.607263] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1045.638779] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.638779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.638779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.638779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.638779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.652923] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1045.821426] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d: rpc.has_security_group_logging(os_id): False [ 1045.846989] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.847235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.847315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.847513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.847638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.848028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.848139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.848251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.848477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.848561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.848827] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.848935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.848992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.849180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.849405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.850058] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.850058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.850058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.850058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.850058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.850493] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 1045.938333] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.938488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.938488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.938757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.938943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.955543] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 1047.495557] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c in Status: SUCCESS [ 1047.495557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.663733] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1047.663980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.664163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.664379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.664568] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.664684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.664753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.664892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.665022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.665097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.665150] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.973077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 1047.973451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.165285] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1048.165285] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1048.167795] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.168857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.168857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.168857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.168857] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.168857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.168857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.169223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.169223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.169223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.169333] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.169391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.169429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.169542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.169678] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.169766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.169826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.169962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.170050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.170132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.170221] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.673173] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50c43a13-ebd7-47b2-924e-039a5d7a4354: rpc.has_security_group_logging(os_id): False [ 1048.697292] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.697597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.697716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.698409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.698652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.699049] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.699286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.699493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.699962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.700253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.700444] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.700626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.700726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.700939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.701091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.701329] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.701486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.701583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.701815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.701922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.702016] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1048.781286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.782016] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.782193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.782488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.782701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.803793] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1050.820256] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1050.820505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.403892] env[65678]: INFO networking_nsxv3.common.synchronization [req-8d2cd837-1892-408c-a209-7fe1b7048a5f req-c2b9d232-0b4b-4c14-a528-096235d1ebc0 tempest-ServerDiskConfigTestJSON-1525559737 tempest-ServerDiskConfigTestJSON-1525559737-project-member] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 1052.403892] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGHEST for action security_group_members [ 1052.404324] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.404324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.404324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.404564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.405078] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.405078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.405078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.405383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.405417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.405655] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.801530] env[65678]: INFO networking_nsxv3.common.synchronization [req-5e448fca-f0eb-48d1-9917-728223746885 req-e6f684fa-c3d1-418f-8f00-b9ab59492ec9 tempest-ServersAdminTestJSON-1252313613 tempest-ServersAdminTestJSON-1252313613-project-member] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1052.802028] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1052.805396] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.805396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.805396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.805396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.805396] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.805396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.805396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.805396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.805396] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.805396] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.909624] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.909822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.909880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.910122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.910224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.910425] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.910522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.910588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.910743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.910825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.910901] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be updated. [ 1052.943337] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.943510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.943560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.943811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.943959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.959674] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: IN_PROGRESS for 2s [ 1053.266026] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.266275] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.266384] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.266712] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.267069] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.267311] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.267450] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.267677] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.267822] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.268085] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.268222] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.268335] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.268910] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.268910] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.268910] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.268910] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.288846] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.289059] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.289164] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.289340] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-755" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.289655] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-d8b12141-9cea-47be-b5a2-1c01a0e555ca taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.289831] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-d8b12141-9cea-47be-b5a2-1c01a0e555ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.289951] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-d8b12141-9cea-47be-b5a2-1c01a0e555ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.290359] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-d8b12141-9cea-47be-b5a2-1c01a0e555ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.290561] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8b12141-9cea-47be-b5a2-1c01a0e555ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.308065] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.687938] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.688291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.688291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.688422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.688533] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.793203] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.793484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.793571] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.793845] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.794019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.794232] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port d8b12141-9cea-47be-b5a2-1c01a0e555ca not found, creating... [ 1053.794501] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.794652] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.794768] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.794996] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.795155] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.795434] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.795586] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.795700] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.796323] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.796552] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.796753] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: d8b12141-9cea-47be-b5a2-1c01a0e555ca is going to be created. [ 1053.810662] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.818096] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.818453] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.818638] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.819071] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.819309] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.819645] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-d8b12141-9cea-47be-b5a2-1c01a0e555ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.193025] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.316033] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.316130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.316493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.316493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.316493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.316590] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1054.346935] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.346935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.346935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.346935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.346935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.356842] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1054.551435] env[65678]: INFO networking_nsxv3.common.synchronization [req-5e448fca-f0eb-48d1-9917-728223746885 req-ca610766-eedd-4591-a103-f40360456bb6 service nova] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_rules [ 1054.551615] env[65678]: INFO networking_nsxv3.common.synchronization [req-5e448fca-f0eb-48d1-9917-728223746885 req-ca610766-eedd-4591-a103-f40360456bb6 service nova] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1054.551749] env[65678]: INFO networking_nsxv3.common.synchronization [req-5e448fca-f0eb-48d1-9917-728223746885 req-ca610766-eedd-4591-a103-f40360456bb6 service nova] Enqueued Resource ID: d8b12141-9cea-47be-b5a2-1c01a0e555ca with Priority: HIGHEST for action port [ 1054.552305] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_rules [ 1054.552443] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1054.552539] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8b12141-9cea-47be-b5a2-1c01a0e555ca with Priority: HIGHEST for action port [ 1054.553420] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.553559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.553631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.553852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.553914] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.554992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.554992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.555114] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8b12141-9cea-47be-b5a2-1c01a0e555ca taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.555210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8b12141-9cea-47be-b5a2-1c01a0e555ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.555311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8b12141-9cea-47be-b5a2-1c01a0e555ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.555762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8b12141-9cea-47be-b5a2-1c01a0e555ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.555762] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8b12141-9cea-47be-b5a2-1c01a0e555ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.693555] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.972117] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d in Status: SUCCESS [ 1054.972505] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d deletion is rescheduled due to dependency. [ 1054.972728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.057933] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.058082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.058285] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8b12141-9cea-47be-b5a2-1c01a0e555ca with status ACTIVE [ 1055.058510] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.058623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.058696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.060512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.060610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.060804] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.060911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.060976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.061172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.061254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.061443] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.061540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.061599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.061731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.061793] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.061883] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8b12141-9cea-47be-b5a2-1c01a0e555ca is going to be updated. [ 1055.086516] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.086516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.086516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.086516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.086850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.086850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8b12141-9cea-47be-b5a2-1c01a0e555ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.131685] env[65678]: INFO networking_nsxv3.common.synchronization [None req-64027018-5f8f-4472-92d4-c561286fb71b None None] Enqueued Resource ID: 4a8b4f7a-7c3d-4b1b-b409-c568b47596de with Priority: HIGHEST for action port [ 1055.132278] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a8b4f7a-7c3d-4b1b-b409-c568b47596de with Priority: HIGHEST for action port [ 1055.132579] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a8b4f7a-7c3d-4b1b-b409-c568b47596de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.132702] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a8b4f7a-7c3d-4b1b-b409-c568b47596de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.132761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a8b4f7a-7c3d-4b1b-b409-c568b47596de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.133081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a8b4f7a-7c3d-4b1b-b409-c568b47596de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.133179] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a8b4f7a-7c3d-4b1b-b409-c568b47596de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.197864] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1055.198037] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1055.639553] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a8b4f7a-7c3d-4b1b-b409-c568b47596de [ 1055.639553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.639553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.639553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.639553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.639553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.639553] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a8b4f7a-7c3d-4b1b-b409-c568b47596de already deleted. [ 1055.639553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a8b4f7a-7c3d-4b1b-b409-c568b47596de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.062767] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.063322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.063322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.063322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.083650] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1056.084599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.086098] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1056.128209] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.128405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.128470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.128782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.142404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.144199] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1056.144199] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.144199] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1056.189740] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.189984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.189984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.190815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.192895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.193018] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1056.295982] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.296211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.296284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.296787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.296882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.302501] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1056.368250] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1056.368451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.368681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.368990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.369448] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.369448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.369448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.369722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.369722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.370161] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.382186] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.382186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.382186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.382186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.382186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.382834] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 1056.382834] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'02e933d1-ac0d-4baa-9da0-e149762ce926', 'eb02d1eb-8ee4-47ad-b890-95d76e24df1b', 'd2de4eec-43fc-4180-be46-e291d4587236', 'e9844dc2-a792-4762-9b70-e918899f67f5', 'e97df514-272c-47bf-a99a-d9d5458cd9ab', 'e24b48ad-1ed5-4566-912b-a63687a8de4d', '009db6c2-7197-4126-8d71-ff2f27ca91b3', '01a87ef9-be93-4585-b9c3-7d62b4b2fe0c', 'dc7f6218-60a3-4bd3-9819-6777964d3718', 'e72b3b22-43b8-43bc-86bc-e0360d10d8e5', 'b3e6206b-217a-495f-93c5-643d3576e725', '6d205434-5ee2-4e1a-bee3-e65c424f311c', 'f6eb745b-f38e-4b8f-9261-fe65a6934037', '393a6f14-3ce6-441b-a403-1993c47b58e3', '25d87d2c-0ecc-4c94-9119-6c94790a0c86', '50c43a13-ebd7-47b2-924e-039a5d7a4354', '961e8451-f48b-412a-8046-631c24d72fe5', '433d6ddb-7487-401b-862b-e16865015657', '5ad6310b-73d1-441e-897d-b412b1e437a2', '92e8fca5-1dcf-494d-a489-044a26543bc2', '9687b7d1-a464-4878-ae3a-b131f314c98b', '6ed86dd0-f355-4dc0-9bd4-91be15af4d6d', 'aec1e262-a46a-4ce5-b4f8-1392575d0891', '433b7d9d-3978-4af8-a278-70a89b5d5f2e', '32f35a35-0102-4d28-a65d-3999b6041978', '1cf83cc4-cb38-45ef-a793-74322cc1b712', 'd196335c-3d4b-49d3-91d2-49ab0c720654', 'be0fa044-c782-451f-a03f-5161e22ff3ca', 'abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb', 'be3b7ec3-66f8-4175-9611-636d9a427a3e', 'a3b380ca-ae52-4449-89ca-b2e647b635d9', '4b06f75c-4a15-46fd-8850-579c633c71af', 'e857e4d2-27dd-462e-87df-ee44911ff684', '850ea458-7bc9-41b1-87fe-f961a64609eb', '6f8fce09-ff14-4f78-bcad-d1a722c00977', '0cad1a85-e250-44ba-929f-39b2137bd736', '2164111b-0060-40e2-86c3-edfc4931cb24', '802af02b-8ef5-41bb-a1fa-3f15ffa69531', 'cddb9167-1b9c-4751-8cf3-4f83a593874e', '394e9a35-6053-4366-8c10-efbb3bbed0b9', '8631425e-c832-4434-9322-1536d9e46bb8', '4f236cc9-1bc2-44e5-b39b-04c5909837a7', '79cab93f-aae5-467c-88f3-35382c30a4ef', '365d72a1-5a30-4ddf-b653-b2fb3c894c63', '40537b9d-ed59-4875-a8af-108e1322d055', 'b634fd1e-f1ec-4189-ac44-9f8fa9578204', '6bf254fe-a02c-4c36-8f89-52a5a801f9b5', '8d58c068-3cf0-4038-b60f-b9591e0abf8a', 'cda39a55-69e8-4fac-bca6-eac8c60627f3', '4bcfce19-b3dc-46b9-a272-88acde866ff3'} {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.382972] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1056.410488] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.410488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.410488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.410488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.410488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.410488] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1056.410488] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.410488] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1056.492361] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.492361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.492361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.492361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.495601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.495930] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1056.498019] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.498019] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1056.498019] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1056.498019] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGH for action security_group_rules [ 1056.498019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.873411] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.378430] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.881317] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.881609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.881609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.881805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.881904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.882023] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1057.917155] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.917155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.917374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.917445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.917646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.930355] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1058.211924] env[65678]: INFO networking_nsxv3.common.synchronization [None req-ff48aa54-d532-457b-9f16-71658229e070 None None] Enqueued Resource ID: d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3 with Priority: HIGHEST for action port [ 1058.212322] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3 with Priority: HIGHEST for action port [ 1058.212402] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGH for action security_group_rules [ 1058.212523] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2de4eec-43fc-4180-be46-e291d4587236 with Priority: HIGH for action security_group_rules [ 1058.212609] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 with Priority: HIGH for action security_group_rules [ 1058.212714] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 with Priority: HIGH for action security_group_rules [ 1058.212714] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 with Priority: HIGH for action security_group_rules [ 1058.212808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433d6ddb-7487-401b-862b-e16865015657 with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc7f6218-60a3-4bd3-9819-6777964d3718 with Priority: HIGH for action security_group_rules [ 1058.213808] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b48ad-1ed5-4566-912b-a63687a8de4d with Priority: HIGH for action security_group_rules [ 1058.214297] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c with Priority: HIGH for action security_group_rules [ 1058.214297] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97df514-272c-47bf-a99a-d9d5458cd9ab with Priority: HIGH for action security_group_rules [ 1058.214297] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b with Priority: HIGH for action security_group_rules [ 1058.214297] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGH for action security_group_rules [ 1058.215038] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.215038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.215038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.215038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.215311] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.216509] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.217517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.217517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.217517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.217517] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.218049] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2de4eec-43fc-4180-be46-e291d4587236 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.218131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.218264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.218387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.218462] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2de4eec-43fc-4180-be46-e291d4587236',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.222150] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-009db6c2-7197-4126-8d71-ff2f27ca91b3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.222289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.222289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.222520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.222520] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('009db6c2-7197-4126-8d71-ff2f27ca91b3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.223946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.224070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.224130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.224345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.224427] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d87d2c-0ecc-4c94-9119-6c94790a0c86',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.225654] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92e8fca5-1dcf-494d-a489-044a26543bc2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.225770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.225832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.225995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.226087] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92e8fca5-1dcf-494d-a489-044a26543bc2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.226809] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ad6310b-73d1-441e-897d-b412b1e437a2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.226918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.226986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.227522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.227601] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ad6310b-73d1-441e-897d-b412b1e437a2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.228725] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433d6ddb-7487-401b-862b-e16865015657 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.228925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.228925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.229084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.229145] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433d6ddb-7487-401b-862b-e16865015657',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.230190] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.230441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.230441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.230575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.230575] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.232533] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393a6f14-3ce6-441b-a403-1993c47b58e3 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.232533] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.232533] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.232533] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.232533] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393a6f14-3ce6-441b-a403-1993c47b58e3',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.232882] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.232970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.233123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.233479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.233605] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.234906] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6eb745b-f38e-4b8f-9261-fe65a6934037 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.234906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.234906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.235344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.235344] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6eb745b-f38e-4b8f-9261-fe65a6934037',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.236802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.236901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.236901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.237068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.237138] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.237941] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.238137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.238280] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.238366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.238435] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.239313] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.239493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.239493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.239687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.239687] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e72b3b22-43b8-43bc-86bc-e0360d10d8e5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.241169] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc7f6218-60a3-4bd3-9819-6777964d3718 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.241497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.241497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.241664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.241664] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc7f6218-60a3-4bd3-9819-6777964d3718',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.242750] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e24b48ad-1ed5-4566-912b-a63687a8de4d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.242877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.242877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.243060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.243136] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e24b48ad-1ed5-4566-912b-a63687a8de4d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.244382] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.244520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.244593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.244719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.244789] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01a87ef9-be93-4585-b9c3-7d62b4b2fe0c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.246603] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e97df514-272c-47bf-a99a-d9d5458cd9ab taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.246753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.246753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.246940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.247043] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e97df514-272c-47bf-a99a-d9d5458cd9ab',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.249083] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.249083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.249083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.249083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.249083] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb02d1eb-8ee4-47ad-b890-95d76e24df1b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.249421] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.249535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.249601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.249752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.249821] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.733340] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.733757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.733757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.733757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.734028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.734028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.734246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.734466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.734582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.734689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.734805] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.736385] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.736538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.736615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.736797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.736980] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.737109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.737177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.737347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.737447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.737534] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.737646] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.751307] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.751553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.751553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.751758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.751965] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.752176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.752176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.752355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.752469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.752571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.752661] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.757127] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3 [ 1058.757309] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.757423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.757521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.757666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.757750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.757836] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3 already deleted. [ 1058.757909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d13ee6d5-8ec2-4f15-b1e6-9a6a2467c7b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.766412] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.766660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.766660] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.766822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.768514] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.768679] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.771532] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.771680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.771738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.772230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.772230] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.772368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.772368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.772492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.772580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.772675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.772763] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.776409] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.776409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.776545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.776686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.776850] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.776946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.777013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.777364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.777364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.777364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.777510] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.782338] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.782496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.790891] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.791101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.793196] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.793344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.796946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.797102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.821687] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.821901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.823908] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.823908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.824875] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.824969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.826784] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.826911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.831308] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.831626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.832531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.832646] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ad6310b-73d1-441e-897d-b412b1e437a2 is going to be deleted. [ 1058.833571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.833821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.835543] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.835658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.836426] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.836526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.837241] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1058.837718] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.837832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.839265] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1058.839704] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.839819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.867255] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1058.867835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.867961] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d87d2c-0ecc-4c94-9119-6c94790a0c86 is going to be deleted. [ 1058.869058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.869289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.898780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.898967] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433d6ddb-7487-401b-862b-e16865015657 is going to be deleted. [ 1058.900358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.900689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.902821] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.902821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.931423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.931699] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc7f6218-60a3-4bd3-9819-6777964d3718 is going to be deleted. [ 1058.933342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.933601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.947177] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.947463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.955285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.955531] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e72b3b22-43b8-43bc-86bc-e0360d10d8e5 is going to be deleted. [ 1058.956449] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.956864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.001858] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.001858] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.025607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.025607] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6eb745b-f38e-4b8f-9261-fe65a6934037 is going to be deleted. [ 1059.026169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.026332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.080323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.080582] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e97df514-272c-47bf-a99a-d9d5458cd9ab is going to be deleted. [ 1059.081932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.082344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.084703] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.084853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.085845] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.086020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.156933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.157102] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01a87ef9-be93-4585-b9c3-7d62b4b2fe0c is going to be deleted. [ 1059.158197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.158469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.195878] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.196100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.202426] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.202644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.239177] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.241805] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.241805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.241805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.241805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.242185] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.242185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.242185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.242378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.242518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.242561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.242698] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.242785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.242848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.242992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.243322] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.243322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.243322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.243747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.243747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.243747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.243747] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.261028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.261488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.261488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.261651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.261776] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.261880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.261943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.262287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.262287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.262393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.262953] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.263189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.263275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.263584] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.263728] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.263863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.263960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.264193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.264348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.264466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.264581] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.280902] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.288319] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.291330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.291532] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be deleted. [ 1059.292762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.293134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.341398] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.341530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.350466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.350635] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393a6f14-3ce6-441b-a403-1993c47b58e3 is going to be deleted. [ 1059.352466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.352810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.396844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.397039] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92e8fca5-1dcf-494d-a489-044a26543bc2 is going to be deleted. [ 1059.398021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.398213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.454542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.454724] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb02d1eb-8ee4-47ad-b890-95d76e24df1b is going to be deleted. [ 1059.455998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.456289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.457899] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.458063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.495339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.495339] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e24b48ad-1ed5-4566-912b-a63687a8de4d is going to be deleted. [ 1059.496188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.496418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.508082] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.508310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.527844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.528013] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 009db6c2-7197-4126-8d71-ff2f27ca91b3 is going to be deleted. [ 1059.529171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.529406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.535595] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.535732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.664988] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.665158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.688764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.688891] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2de4eec-43fc-4180-be46-e291d4587236 is going to be deleted. [ 1059.690442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.690442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.690442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.690442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ad6310b-73d1-441e-897d-b412b1e437a2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.690682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.690682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.690682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.690781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d87d2c-0ecc-4c94-9119-6c94790a0c86" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.693432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.693615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.693711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.693835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433d6ddb-7487-401b-862b-e16865015657" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.694025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.694167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.694312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.694482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc7f6218-60a3-4bd3-9819-6777964d3718" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.694621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.694773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e72b3b22-43b8-43bc-86bc-e0360d10d8e5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e97df514-272c-47bf-a99a-d9d5458cd9ab" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6eb745b-f38e-4b8f-9261-fe65a6934037" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01a87ef9-be93-4585-b9c3-7d62b4b2fe0c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.696594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.697146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.697146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.697146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.697146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.697270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.697270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.697341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393a6f14-3ce6-441b-a403-1993c47b58e3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.697470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.698108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.698224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.698348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92e8fca5-1dcf-494d-a489-044a26543bc2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.698489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.698644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.698755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.698893] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb02d1eb-8ee4-47ad-b890-95d76e24df1b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.741167] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.741167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.741167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.741507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.741507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.741507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e24b48ad-1ed5-4566-912b-a63687a8de4d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.746221] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 961e8451-f48b-412a-8046-631c24d72fe5: rpc.has_security_group_logging(os_id): False [ 1059.747515] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50c43a13-ebd7-47b2-924e-039a5d7a4354: rpc.has_security_group_logging(os_id): False [ 1059.770132] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d205434-5ee2-4e1a-bee3-e65c424f311c: rpc.has_security_group_logging(os_id): False [ 1059.782351] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.782560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.782630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.782917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.783046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.783108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-009db6c2-7197-4126-8d71-ff2f27ca91b3" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.784896] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9844dc2-a792-4762-9b70-e918899f67f5: rpc.has_security_group_logging(os_id): False [ 1059.796339] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3e6206b-217a-495f-93c5-643d3576e725: rpc.has_security_group_logging(os_id): False [ 1059.813506] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.813506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.813506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.813727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.815816] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.815954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.826100] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.826196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.829920] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.830118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.836101] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.836220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.849608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.849930] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.850042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.850109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.850308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.850395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.850489] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 is going to be updated. [ 1059.851630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.851817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.862176] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.862388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.906370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.906897] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.907083] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.907216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.907514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.907670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.907946] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.908127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.908237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.908482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.908734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.908921] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.909088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.909207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.909431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.909553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.909725] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1059.910980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.911218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.948916] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1059.949338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.949530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.949826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.950092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.950258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.950332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.950571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.950701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.950842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.950992] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.961315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.961617] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.961801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.961906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.962307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.962462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.962628] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.962773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.962855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.962978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.963086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.963419] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.963545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.963620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.964098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.964098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.964098] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c is going to be updated. [ 1059.965449] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.965697] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.002973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.003426] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.003525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.003598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.003835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.003926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.004036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1060.005448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.005644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.007551] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.007721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.048654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.049120] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.049304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.049395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.049694] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.049843] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.049996] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3e6206b-217a-495f-93c5-643d3576e725 is going to be updated. [ 1060.051343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.051704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.051831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.051997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2de4eec-43fc-4180-be46-e291d4587236" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.052196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.052425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.052596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.080299] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.080299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.080299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.080299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.080710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.084332] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.084332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.084634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.084634] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.084773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.103793] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c in Status: IN_PROGRESS for 2s [ 1060.104605] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1060.105289] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: IN_PROGRESS for 2s [ 1060.189589] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.189735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.189813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.190180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.190315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.217537] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1060.225692] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1060.226327] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.226498] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.226652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.226948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.226948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.264496] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3e6206b-217a-495f-93c5-643d3576e725 in Status: IN_PROGRESS for 2s [ 1060.454038] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.454197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.454197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.454503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.454716] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.454887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.454887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.454980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.455086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.455170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.455317] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.455411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.455491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.455638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.456257] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.456257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.456257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.456257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.456257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.456257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.456585] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.958926] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f236cc9-1bc2-44e5-b39b-04c5909837a7: rpc.has_security_group_logging(os_id): False [ 1060.978247] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.978392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.978450] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.978673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.002999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.003312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.003442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.003512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.003713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.003812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.003985] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.004089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.004158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.004316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.004394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.004580] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.004674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.004737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.004878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.004953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.005184] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1061.025758] env[65678]: INFO networking_nsxv3.common.synchronization [req-07e901c6-02a7-4bf2-b177-105fd75bcdfe req-362641fa-9af6-481b-b151-a04cf7d62cbe tempest-FloatingIPsAssociationNegativeTestJSON-1007333382 tempest-FloatingIPsAssociationNegativeTestJSON-1007333382-project-member] Enqueued Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGHEST for action security_group_members [ 1061.026342] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGHEST for action security_group_members [ 1061.026655] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.026778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.026846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.027060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.027210] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.027305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.027365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.027510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.027593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.027683] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.069475] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.069632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.069709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.069921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.070077] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.085351] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1061.530526] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.530680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.530743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.531477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.531477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.531477] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.531477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.531477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.531751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.531751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.531751] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c is going to be updated. [ 1061.561971] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.562159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.562270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.562467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.562610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.572496] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c in Status: IN_PROGRESS for 2s [ 1061.793129] env[65678]: INFO networking_nsxv3.common.synchronization [req-3b4328da-4c4d-4f2b-9137-6162fdd4f591 req-ed36f175-7a1a-48ca-9c0a-2b8031dd9278 tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 1061.793646] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 1061.793954] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.799383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.799383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.799383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.799383] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.799383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.799383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.799383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.799383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.799383] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.119543] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: SUCCESS [ 1062.119939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.120899] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c in Status: SUCCESS [ 1062.120899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.121508] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1062.121675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.232118] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1062.232118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.261691] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.261691] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.261894] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.262643] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.262643] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.262643] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.262643] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.262867] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.262867] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.263061] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.263174] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1062.263273] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1062.263369] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1062.263467] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1062.263563] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1062.263688] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.286836] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3e6206b-217a-495f-93c5-643d3576e725 in Status: SUCCESS [ 1062.287294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.300645] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.300817] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1062.301035] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.301198] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.301453] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.302115] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.302115] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.302255] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.302297] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dbdc383-82a8-4c26-bea3-c12e3ed8399b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.303823] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.303823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.303823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.303823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.303823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.304095] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.304095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.304209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.304295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.304386] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.304484] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d86ff68-550b-40c3-8567-854372ec34de is going to be deleted. [ 1062.337892] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.338094] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.338186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.338455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.338579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.338708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.806885] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.807116] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.807245] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.807531] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.807682] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.807840] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 4dbdc383-82a8-4c26-bea3-c12e3ed8399b not found, creating... [ 1062.808114] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.808362] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.808438] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.808595] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.808730] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.809016] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.809173] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.809292] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.809500] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.809632] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.809769] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 4dbdc383-82a8-4c26-bea3-c12e3ed8399b is going to be created. [ 1062.831375] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.831597] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.831694] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.831978] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.832269] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.832662] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.103664] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1063.103908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.540651] env[65678]: INFO networking_nsxv3.common.synchronization [req-3b4328da-4c4d-4f2b-9137-6162fdd4f591 req-c187acff-5e7e-4b83-ae23-01ead9a93e7c service nova] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_rules [ 1063.540929] env[65678]: INFO networking_nsxv3.common.synchronization [req-3b4328da-4c4d-4f2b-9137-6162fdd4f591 req-c187acff-5e7e-4b83-ae23-01ead9a93e7c service nova] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 1063.541169] env[65678]: INFO networking_nsxv3.common.synchronization [req-3b4328da-4c4d-4f2b-9137-6162fdd4f591 req-c187acff-5e7e-4b83-ae23-01ead9a93e7c service nova] Enqueued Resource ID: 4dbdc383-82a8-4c26-bea3-c12e3ed8399b with Priority: HIGHEST for action port [ 1063.541686] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_rules [ 1063.541860] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 1063.541984] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dbdc383-82a8-4c26-bea3-c12e3ed8399b with Priority: HIGHEST for action port [ 1063.542327] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.542448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.542540] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.542759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.542875] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.543823] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.543977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.544101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.544411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.544528] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.544620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.544709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.545713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.545713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.545713] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.545996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.545996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.545996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.546174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.546174] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dbdc383-82a8-4c26-bea3-c12e3ed8399b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.592619] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c in Status: SUCCESS [ 1063.592763] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c deletion is rescheduled due to dependency. [ 1063.592878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.048242] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.048719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.048982] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.049973] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4dbdc383-82a8-4c26-bea3-c12e3ed8399b with status ACTIVE [ 1064.050198] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.050293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.050359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.051988] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.051988] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.051988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.051988] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4dbdc383-82a8-4c26-bea3-c12e3ed8399b is going to be updated. [ 1064.082170] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.082382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.082431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.082632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.082769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.082944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.239993] env[65678]: INFO networking_nsxv3.common.synchronization [req-022cc7c2-5dcd-4a71-9bdf-d8e828929c17 req-c4c439ad-bdff-46aa-8a7b-4d042c841cd8 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1064.240884] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1064.241255] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.242129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.242129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.242129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.242129] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.242129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.242129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.242502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.242502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.242502] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.553775] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.640166] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.640408] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.641016] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.641579] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.641875] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.642096] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.642310] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.642664] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.642895] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.643250] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.643463] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.643655] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.643850] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.644052] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.644240] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.644481] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.666882] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.667299] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1064.667554] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.667873] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.668327] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-d1e25461-ad30-4f09-926c-d1fad6355305 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.668668] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-d1e25461-ad30-4f09-926c-d1fad6355305" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.668926] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-d1e25461-ad30-4f09-926c-d1fad6355305" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.669419] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-d1e25461-ad30-4f09-926c-d1fad6355305" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.670025] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e25461-ad30-4f09-926c-d1fad6355305',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.747656] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.058762] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.058925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.058967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.059388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.059388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.059388] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d86ff68-550b-40c3-8567-854372ec34de is going to be created. [ 1065.087234] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.087234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.087234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.087502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.087974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.099722] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: UNINITIALIZED for 2s [ 1065.172145] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.172377] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.172512] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.172799] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.172964] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.173111] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port d1e25461-ad30-4f09-926c-d1fad6355305 not found, creating... [ 1065.173369] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.173524] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.173643] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.173864] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.174000] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.174290] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.174463] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.174590] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.174799] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.174930] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.175086] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: d1e25461-ad30-4f09-926c-d1fad6355305 is going to be created. [ 1065.199225] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.199499] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.199622] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.199995] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.200333] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.200734] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-d1e25461-ad30-4f09-926c-d1fad6355305" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.249089] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.751826] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.752258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.752258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.752368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.752445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.752563] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1065.788461] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.788629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.788703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.788921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.789195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.799880] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1065.952690] env[65678]: INFO networking_nsxv3.common.synchronization [req-022cc7c2-5dcd-4a71-9bdf-d8e828929c17 req-7c6dfde2-46f8-4e51-aaa4-694b62478ea2 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1065.952690] env[65678]: INFO networking_nsxv3.common.synchronization [req-022cc7c2-5dcd-4a71-9bdf-d8e828929c17 req-7c6dfde2-46f8-4e51-aaa4-694b62478ea2 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1065.952690] env[65678]: INFO networking_nsxv3.common.synchronization [req-022cc7c2-5dcd-4a71-9bdf-d8e828929c17 req-7c6dfde2-46f8-4e51-aaa4-694b62478ea2 service nova] Enqueued Resource ID: d1e25461-ad30-4f09-926c-d1fad6355305 with Priority: HIGHEST for action port [ 1065.952690] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1065.953197] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1065.953197] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1e25461-ad30-4f09-926c-d1fad6355305 with Priority: HIGHEST for action port [ 1065.953197] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.953354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.953354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.953646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.953646] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.954727] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.954727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.954906] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1e25461-ad30-4f09-926c-d1fad6355305 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.955024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1e25461-ad30-4f09-926c-d1fad6355305" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.955024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1e25461-ad30-4f09-926c-d1fad6355305" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.955216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1e25461-ad30-4f09-926c-d1fad6355305" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.955300] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e25461-ad30-4f09-926c-d1fad6355305',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.219015] env[65678]: INFO networking_nsxv3.common.synchronization [req-2207be06-365d-4275-ac9c-8bbd37961a43 req-01922b3c-f801-42ff-96b9-0b35edf04a06 tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1066.219015] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1066.219403] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.219727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.221257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.221257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.221257] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.221257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.221257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.221257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.221257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.221257] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.459254] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.459395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.459557] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1e25461-ad30-4f09-926c-d1fad6355305 with status ACTIVE [ 1066.459718] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.459836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.459927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.460269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.460361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.460545] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.460692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.460735] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.462938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.463060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.463274] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.463375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.463437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.463669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.463773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.463888] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1e25461-ad30-4f09-926c-d1fad6355305 is going to be updated. [ 1066.487774] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.487774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.487774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.487774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.487774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.487774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1e25461-ad30-4f09-926c-d1fad6355305" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.673173] env[65678]: INFO networking_nsxv3.common.synchronization [req-1b25bee8-b205-4a77-8e89-9a72eac036b1 req-b750768d-accc-45fe-888d-6ebd5f475f32 tempest-ServerPasswordTestJSON-365295155 tempest-ServerPasswordTestJSON-365295155-project-member] Enqueued Resource ID: 5b13ea87-a34e-4663-aca7-94955d02166c with Priority: HIGHEST for action security_group_members [ 1066.673775] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b13ea87-a34e-4663-aca7-94955d02166c with Priority: HIGHEST for action security_group_members [ 1066.677686] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b13ea87-a34e-4663-aca7-94955d02166c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.677874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.677937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.678213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.678812] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.678956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.679036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.680010] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.680125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.680226] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b13ea87-a34e-4663-aca7-94955d02166c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.723256] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.723476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.723579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.723898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.724057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.724352] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.724532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.724631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.724866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.724998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.725119] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1066.767990] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.768550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.768550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.768550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.768930] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.778754] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1067.111775] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: SUCCESS [ 1067.111775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.111775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.111775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.111775] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.112248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.112248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.112248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.112248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.112248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.112510] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.164942] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-551 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.165287] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-551" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.165340] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-551" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.166242] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-551" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.166528] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.166731] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.166926] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.167193] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.167393] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.167630] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.167752] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.168510] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.168510] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.168510] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.168510] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.168510] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.182281] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.182497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.182603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.182888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.183036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.183286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.183437] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.183516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.183755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.183867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.183981] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b13ea87-a34e-4663-aca7-94955d02166c already deleted. [ 1067.184114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.187838] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.188060] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.188246] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.188477] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-551" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.188846] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-723909c9-2f74-4cdc-9140-0af87a0af4dc taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.189044] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-723909c9-2f74-4cdc-9140-0af87a0af4dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.189171] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-723909c9-2f74-4cdc-9140-0af87a0af4dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.189496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-723909c9-2f74-4cdc-9140-0af87a0af4dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.189643] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('723909c9-2f74-4cdc-9140-0af87a0af4dc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.620208] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.620208] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.620208] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.620208] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.620208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.621162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.621162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.621162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.621162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.621162] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.692709] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.692709] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.692709] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.693039] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.693147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.693323] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 723909c9-2f74-4cdc-9140-0af87a0af4dc not found, creating... [ 1067.693616] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.693791] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.693913] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.694236] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.694338] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.694700] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.694871] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.695062] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.695293] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.695437] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.695594] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 723909c9-2f74-4cdc-9140-0af87a0af4dc is going to be created. [ 1067.725786] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.726092] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.726276] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.726641] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.726966] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.727258] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-723909c9-2f74-4cdc-9140-0af87a0af4dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.817463] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1067.817750] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.817870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.818124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.818342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.818463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.818529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.818696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.818777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.818873] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.122809] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d86ff68-550b-40c3-8567-854372ec34de: rpc.has_security_group_logging(os_id): False [ 1068.157349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.157525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.157602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.157815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.157907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.158147] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.158245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.158304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.158455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.158604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.158801] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.158896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.158956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.159115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.159188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.159359] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.159522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.159607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.159757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.159832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.159919] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d86ff68-550b-40c3-8567-854372ec34de is going to be created. [ 1068.248547] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.248761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.248761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.250034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.250034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.263103] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: IN_PROGRESS for 2s [ 1068.320907] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.457807] env[65678]: INFO networking_nsxv3.common.synchronization [req-1b25bee8-b205-4a77-8e89-9a72eac036b1 req-0ac20e4c-2124-4faf-8663-0feb30e5570b service nova] Enqueued Resource ID: 5b13ea87-a34e-4663-aca7-94955d02166c with Priority: HIGHEST for action security_group_rules [ 1068.458119] env[65678]: INFO networking_nsxv3.common.synchronization [req-1b25bee8-b205-4a77-8e89-9a72eac036b1 req-0ac20e4c-2124-4faf-8663-0feb30e5570b service nova] Enqueued Resource ID: 5b13ea87-a34e-4663-aca7-94955d02166c with Priority: HIGHEST for action security_group_members [ 1068.458335] env[65678]: INFO networking_nsxv3.common.synchronization [req-1b25bee8-b205-4a77-8e89-9a72eac036b1 req-0ac20e4c-2124-4faf-8663-0feb30e5570b service nova] Enqueued Resource ID: 723909c9-2f74-4cdc-9140-0af87a0af4dc with Priority: HIGHEST for action port [ 1068.458963] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b13ea87-a34e-4663-aca7-94955d02166c with Priority: HIGHEST for action security_group_rules [ 1068.459240] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b13ea87-a34e-4663-aca7-94955d02166c with Priority: HIGHEST for action security_group_members [ 1068.459344] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 723909c9-2f74-4cdc-9140-0af87a0af4dc with Priority: HIGHEST for action port [ 1068.459650] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b13ea87-a34e-4663-aca7-94955d02166c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.459785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.459872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.460333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.460333] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b13ea87-a34e-4663-aca7-94955d02166c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.462689] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b13ea87-a34e-4663-aca7-94955d02166c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.462689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.462689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.462689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.462689] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.462689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.462689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.462689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.462689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.462689] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b13ea87-a34e-4663-aca7-94955d02166c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.463452] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-723909c9-2f74-4cdc-9140-0af87a0af4dc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.463452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-723909c9-2f74-4cdc-9140-0af87a0af4dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.463452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-723909c9-2f74-4cdc-9140-0af87a0af4dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.463452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-723909c9-2f74-4cdc-9140-0af87a0af4dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.463452] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('723909c9-2f74-4cdc-9140-0af87a0af4dc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.790562] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1068.790730] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1068.791284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.823922] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.968057] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b13ea87-a34e-4663-aca7-94955d02166c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.968057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.968057] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b13ea87-a34e-4663-aca7-94955d02166c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.968057] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 723909c9-2f74-4cdc-9140-0af87a0af4dc with status ACTIVE [ 1068.968287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.968420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.968476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.971873] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.971873] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.971873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.971873] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 723909c9-2f74-4cdc-9140-0af87a0af4dc is going to be updated. [ 1068.996026] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.996263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.996365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.996631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.996806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.997025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-723909c9-2f74-4cdc-9140-0af87a0af4dc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.328435] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.328435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.328435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.328435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.328435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.328435] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1069.389482] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.389662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.389710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.389911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.390073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.409260] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1069.474882] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b13ea87-a34e-4663-aca7-94955d02166c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.976829] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.977167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.977167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.977330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.977416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.977511] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b13ea87-a34e-4663-aca7-94955d02166c is going to be created. [ 1070.003887] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.004059] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.004133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.004339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.004499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.015820] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b13ea87-a34e-4663-aca7-94955d02166c in Status: UNINITIALIZED for 2s [ 1070.281457] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: SUCCESS [ 1070.281457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.407231] env[65678]: INFO networking_nsxv3.common.synchronization [None req-536012fd-d8ef-4775-851f-bed41c3f4e33 None None] Enqueued Resource ID: 89321383-bd70-4f38-bedd-4013c9eacbdd with Priority: HIGHEST for action port [ 1070.407470] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89321383-bd70-4f38-bedd-4013c9eacbdd with Priority: HIGHEST for action port [ 1070.407793] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-89321383-bd70-4f38-bedd-4013c9eacbdd taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.407933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89321383-bd70-4f38-bedd-4013c9eacbdd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.408082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89321383-bd70-4f38-bedd-4013c9eacbdd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.409522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89321383-bd70-4f38-bedd-4013c9eacbdd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.409650] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89321383-bd70-4f38-bedd-4013c9eacbdd',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.912640] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89321383-bd70-4f38-bedd-4013c9eacbdd [ 1070.912935] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.913153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.913237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.913542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.913653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.913757] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89321383-bd70-4f38-bedd-4013c9eacbdd already deleted. [ 1070.913857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89321383-bd70-4f38-bedd-4013c9eacbdd" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.421337] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1071.421593] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.421738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.421954] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.422155] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.422268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.422330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.422479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.422561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.422666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.422753] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.930149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.930149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.930149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.930149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.930149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.930149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.930149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.930592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.930592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.930592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.930958] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.931117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.931268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.931551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.931781] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.931967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.935039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.935039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.935039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.935039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.935039] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.029231] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b13ea87-a34e-4663-aca7-94955d02166c in Status: SUCCESS [ 1072.029480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.029703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.030027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.030248] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.030429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.030531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.030674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.030753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.030864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.030958] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b13ea87-a34e-4663-aca7-94955d02166c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.127786] env[65678]: INFO networking_nsxv3.common.synchronization [req-9dbf442a-2511-4700-b190-2339401361be req-c292eb75-4dde-4386-9468-59190f595e24 tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 1072.128458] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGHEST for action security_group_members [ 1072.128646] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.128773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.128833] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.129407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.129407] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.129407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.130278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.130381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.130482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.130584] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.195748] env[65678]: INFO networking_nsxv3.common.synchronization [req-9dbf442a-2511-4700-b190-2339401361be req-c292eb75-4dde-4386-9468-59190f595e24 tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 4dbdc383-82a8-4c26-bea3-c12e3ed8399b with Priority: HIGHEST for action port [ 1072.195867] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dbdc383-82a8-4c26-bea3-c12e3ed8399b with Priority: HIGHEST for action port [ 1072.196190] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.196342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.196432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.196686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.196802] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dbdc383-82a8-4c26-bea3-c12e3ed8399b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.441436] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79cab93f-aae5-467c-88f3-35382c30a4ef: rpc.has_security_group_logging(os_id): False [ 1072.463151] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.463349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.463401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.463610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.488598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.490172] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.490330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.490397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.490672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.490766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.490971] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.491147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.491147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.491318] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.491395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.491622] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.491721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.491787] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.491931] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.492014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.494330] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1072.537026] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b13ea87-a34e-4663-aca7-94955d02166c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.537026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.537026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.537026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.537026] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.537026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.537026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.537504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.537504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.537504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.537504] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b13ea87-a34e-4663-aca7-94955d02166c taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.537727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.537727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.537889] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.537939] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.538017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.538147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.541483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.541483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.541483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.541483] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b13ea87-a34e-4663-aca7-94955d02166c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.573252] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.573252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.573252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.573461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.574061] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.589762] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1072.636908] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.636908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.636908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.636908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.636908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.636908] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.636908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.636908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.636908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.636908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.636908] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d86ff68-550b-40c3-8567-854372ec34de is going to be updated. [ 1072.683843] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.684067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.684116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.684293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.684481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.694476] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: IN_PROGRESS for 2s [ 1072.699175] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4dbdc383-82a8-4c26-bea3-c12e3ed8399b with status ACTIVE [ 1072.699175] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.699440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.699440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.699522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.699671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.699912] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.699912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.700074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.700110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.700221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.701054] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.701054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.701054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.701054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.701054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.701054] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4dbdc383-82a8-4c26-bea3-c12e3ed8399b is going to be updated. [ 1072.734783] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.734783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.734783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.734783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.734783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.735135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dbdc383-82a8-4c26-bea3-c12e3ed8399b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.045235] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b13ea87-a34e-4663-aca7-94955d02166c: rpc.has_security_group_logging(os_id): False [ 1073.066045] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.066187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.066379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.066588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.067211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.067522] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.067728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.067728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.067888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.067967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.068511] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.069085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.069085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.069085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.071323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.071323] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.071323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.071323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.071323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.071323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.071323] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b13ea87-a34e-4663-aca7-94955d02166c is going to be created. [ 1073.137773] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.137939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.138136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.138376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.138376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.142514] env[65678]: INFO networking_nsxv3.common.synchronization [None req-5ed338ce-b472-41dd-b88e-020a08ac7748 None None] Enqueued Resource ID: 927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b with Priority: HIGHEST for action port [ 1073.143864] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b with Priority: HIGHEST for action port [ 1073.143864] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.143864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.143864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.144322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.144322] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.151766] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b13ea87-a34e-4663-aca7-94955d02166c in Status: IN_PROGRESS for 2s [ 1073.648697] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b [ 1073.649122] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.649292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.649354] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.649733] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.649851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.650086] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b already deleted. [ 1073.650216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-927e7a8c-b5db-498c-bdf4-b3c1f3cf4c7b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.607185] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1074.607598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.709108] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d86ff68-550b-40c3-8567-854372ec34de in Status: SUCCESS [ 1074.709108] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d86ff68-550b-40c3-8567-854372ec34de deletion is rescheduled due to dependency. [ 1074.709108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.167313] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b13ea87-a34e-4663-aca7-94955d02166c in Status: SUCCESS [ 1075.167313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.720478] env[65678]: INFO networking_nsxv3.common.synchronization [req-a11c251a-1dc2-4c06-9dc0-e9cfd5be433f req-ef5b5e4c-b1a0-4aeb-889a-fb1d3c6bc7ab tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1075.721451] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1075.721507] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.721687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.723135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.723135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.724363] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.724553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.724618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.724848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.724977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.725080] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.231277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.231653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.231653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.234037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.234037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.234037] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.234037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.234037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.234037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.234037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.234037] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1076.273281] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.273477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.273585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.273834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.274046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.287363] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1077.594710] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d49b3c9-0bc9-425b-8c4c-06810e966628 req-78f64309-7440-4410-9a1e-ece55af10a51 tempest-MultipleCreateTestJSON-1045728445 tempest-MultipleCreateTestJSON-1045728445-project-member] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1077.595945] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1077.596526] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.596695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.596761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.597088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.597321] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.597481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.597595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.597788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.597941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.598096] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.100130] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.100365] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.100490] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.100859] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.105265] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.105468] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.105588] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.105873] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.106072] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.106313] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.106445] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.106561] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.106668] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.106789] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1078.106896] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.107252] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.108746] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.108891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.108967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.109120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.109195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.109527] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.109675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.109675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.109971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.110082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.110152] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 already deleted. [ 1078.110263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.128723] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.128956] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1078.129296] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.129414] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.129702] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.129905] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.130077] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.130483] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.130618] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c170cc4c-0e11-4ed4-a0f0-ec9b680720b4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.302361] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1078.302612] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 deletion is rescheduled due to dependency. [ 1078.302833] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.632904] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.633256] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.633312] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.633565] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.633738] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.633900] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port c170cc4c-0e11-4ed4-a0f0-ec9b680720b4 not found, creating... [ 1078.634341] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.634481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.634481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.634725] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.634950] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.635227] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.635393] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.635520] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.635750] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.635893] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.636043] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: c170cc4c-0e11-4ed4-a0f0-ec9b680720b4 is going to be created. [ 1078.662443] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.662706] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.662760] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.663092] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.663331] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.663577] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.403468] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d49b3c9-0bc9-425b-8c4c-06810e966628 req-a334b061-d27d-4497-a2be-7e001079a658 service nova] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_rules [ 1079.403696] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d49b3c9-0bc9-425b-8c4c-06810e966628 req-a334b061-d27d-4497-a2be-7e001079a658 service nova] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1079.403899] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d49b3c9-0bc9-425b-8c4c-06810e966628 req-a334b061-d27d-4497-a2be-7e001079a658 service nova] Enqueued Resource ID: c170cc4c-0e11-4ed4-a0f0-ec9b680720b4 with Priority: HIGHEST for action port [ 1079.404600] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_rules [ 1079.404768] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1079.404926] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c170cc4c-0e11-4ed4-a0f0-ec9b680720b4 with Priority: HIGHEST for action port [ 1079.405296] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.405443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.405516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.405877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.405953] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.406866] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.407015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.407096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.407287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.407442] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.407553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.407698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.407757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.407859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.407964] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.408858] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.408982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.409152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.409256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.409313] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c170cc4c-0e11-4ed4-a0f0-ec9b680720b4',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.911797] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.912244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.912244] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.913103] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c170cc4c-0e11-4ed4-a0f0-ec9b680720b4 with status ACTIVE [ 1079.913286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.913435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.913493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.913709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.915205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.915205] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.915205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.915205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.915205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.915205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.915205] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.915205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.915205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.915205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.915205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.915205] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c170cc4c-0e11-4ed4-a0f0-ec9b680720b4 is going to be updated. [ 1079.939840] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.943092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.943255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.943536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.943751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.943980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c170cc4c-0e11-4ed4-a0f0-ec9b680720b4" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.007270] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d49b3c9-0bc9-425b-8c4c-06810e966628 req-c70e349b-f02e-49be-bf57-f9f22b32ec6c tempest-MultipleCreateTestJSON-1045728445 tempest-MultipleCreateTestJSON-1045728445-project-member] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1080.007921] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1080.008325] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.008696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.362257] env[65678]: INFO networking_nsxv3.common.synchronization [req-e2e11c39-1631-4453-a33f-aa262a64b947 req-9700eeeb-9ca2-4cba-96cf-1e869428bd4c tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_members [ 1080.362913] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGHEST for action security_group_members [ 1080.363175] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.363299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.363367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.363567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.363716] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.363828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.363891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.364056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.364143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.364236] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.390502] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.390729] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.390812] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.391147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.391496] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.391660] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.391773] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.392010] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.392172] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.392383] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.392491] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.392597] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.392806] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.393009] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.393196] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.393386] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.418085] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.418358] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1080.418458] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.418733] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.419098] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-5fc7700c-5659-4ffb-b804-93636ba90336 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.419400] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-5fc7700c-5659-4ffb-b804-93636ba90336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.419592] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-5fc7700c-5659-4ffb-b804-93636ba90336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.419958] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-5fc7700c-5659-4ffb-b804-93636ba90336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.420118] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fc7700c-5659-4ffb-b804-93636ba90336',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.421086] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.869168] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.869168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.869168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.869168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.869168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.869168] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.869168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.869168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.869478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.869478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.869478] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3e6206b-217a-495f-93c5-643d3576e725 is going to be updated. [ 1080.904623] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.904623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.904623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.904623] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.904991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.916167] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3e6206b-217a-495f-93c5-643d3576e725 in Status: IN_PROGRESS for 2s [ 1080.922920] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.926165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.926165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.926165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.926165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.926165] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 5fc7700c-5659-4ffb-b804-93636ba90336 not found, creating... [ 1080.926165] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.926165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.926165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.926165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.926165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.927983] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.929023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.929023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.929023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.929023] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.929208] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 5fc7700c-5659-4ffb-b804-93636ba90336 is going to be created. [ 1080.931446] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.931446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.931446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.931784] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.931784] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.931784] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be created. [ 1080.962858] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.963256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.963256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.963393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.963568] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.966740] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.967167] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.967167] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.968011] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.968304] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.968590] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-5fc7700c-5659-4ffb-b804-93636ba90336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.980787] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: UNINITIALIZED for 2s [ 1081.727089] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d49b3c9-0bc9-425b-8c4c-06810e966628 req-ff26b925-2102-4101-bde8-31ab0935cfc4 service nova] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_rules [ 1081.727089] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d49b3c9-0bc9-425b-8c4c-06810e966628 req-ff26b925-2102-4101-bde8-31ab0935cfc4 service nova] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1081.727089] env[65678]: INFO networking_nsxv3.common.synchronization [req-1d49b3c9-0bc9-425b-8c4c-06810e966628 req-ff26b925-2102-4101-bde8-31ab0935cfc4 service nova] Enqueued Resource ID: 5fc7700c-5659-4ffb-b804-93636ba90336 with Priority: HIGHEST for action port [ 1081.728397] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_rules [ 1081.730444] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1081.731044] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fc7700c-5659-4ffb-b804-93636ba90336 with Priority: HIGHEST for action port [ 1081.731652] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.731760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.731972] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.732084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.732271] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fc7700c-5659-4ffb-b804-93636ba90336 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.732374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fc7700c-5659-4ffb-b804-93636ba90336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.732440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fc7700c-5659-4ffb-b804-93636ba90336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.732648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fc7700c-5659-4ffb-b804-93636ba90336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.732737] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fc7700c-5659-4ffb-b804-93636ba90336',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.739886] env[65678]: INFO networking_nsxv3.common.synchronization [req-c4bdd52b-952b-4c08-a426-2029aa4b8d1d req-f0274879-9479-4dc9-a0da-82dd82b8b6d9 tempest-ServerPasswordTestJSON-365295155 tempest-ServerPasswordTestJSON-365295155-project-member] Enqueued Resource ID: 5b13ea87-a34e-4663-aca7-94955d02166c with Priority: HIGHEST for action security_group_members [ 1081.740497] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b13ea87-a34e-4663-aca7-94955d02166c with Priority: HIGHEST for action security_group_members [ 1081.740673] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b13ea87-a34e-4663-aca7-94955d02166c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.740801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.740875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.741172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.741366] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.741458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.741503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.741665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.741766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.741874] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b13ea87-a34e-4663-aca7-94955d02166c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.236285] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fc7700c-5659-4ffb-b804-93636ba90336 with status ACTIVE [ 1082.236610] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.236855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.236855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.237099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.237186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.237358] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.237465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.237529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.237696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.237776] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.237969] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.238073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.238117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.238294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.238380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.238469] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fc7700c-5659-4ffb-b804-93636ba90336 is going to be updated. [ 1082.243744] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.243922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.244000] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.244322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.244466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.244719] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.244854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.245093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.245300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.245444] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.245567] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b13ea87-a34e-4663-aca7-94955d02166c is going to be updated. [ 1082.272896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.273164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.273332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.273576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.273779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.273975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fc7700c-5659-4ffb-b804-93636ba90336" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.282963] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.283185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.283185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.283418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.283562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.300974] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b13ea87-a34e-4663-aca7-94955d02166c in Status: IN_PROGRESS for 2s [ 1082.926719] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3e6206b-217a-495f-93c5-643d3576e725 in Status: SUCCESS [ 1082.926987] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3e6206b-217a-495f-93c5-643d3576e725 deletion is rescheduled due to dependency. [ 1082.927116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.991470] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1082.992203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.992203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.992203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.992392] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.992800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.992800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.992935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.993096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.993212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.993314] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.994254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.994426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.994629] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.994751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.994816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.994987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.995108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.995203] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.496888] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.497327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.497327] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.000831] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.312077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b13ea87-a34e-4663-aca7-94955d02166c in Status: SUCCESS [ 1084.312337] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b13ea87-a34e-4663-aca7-94955d02166c deletion is rescheduled due to dependency. [ 1084.312502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b13ea87-a34e-4663-aca7-94955d02166c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.507127] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.507127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.507127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.507127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.507127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.507127] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1084.553551] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.553790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.553871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.554120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.554509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.568089] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1084.636968] env[65678]: INFO networking_nsxv3.common.synchronization [req-0f52e7f9-ffdd-442f-b925-b63b4c40e3c9 req-f281f5d2-2f66-435d-afd3-e12841f9ab87 tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1084.638612] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1084.639256] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.639490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.639647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.639911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.640254] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.640431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.640524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.640747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.640869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.640992] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.010062] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.010305] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.010427] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.010699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.013075] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.013075] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.013075] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.013075] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.013075] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.013075] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.013075] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.013075] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.013075] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.013075] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.013075] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.013075] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.036032] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.036032] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.036032] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.036032] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.036032] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-a217e3f8-3ae9-4da9-9d28-54454f6094c1 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.036032] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-a217e3f8-3ae9-4da9-9d28-54454f6094c1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.036032] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-a217e3f8-3ae9-4da9-9d28-54454f6094c1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.036032] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-a217e3f8-3ae9-4da9-9d28-54454f6094c1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.036032] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a217e3f8-3ae9-4da9-9d28-54454f6094c1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.143593] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.143719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.143788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.144013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.144109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.144298] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.144761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.144761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.144761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.144761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.144900] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1085.177610] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.177610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.177610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.178187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.178258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.190807] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1085.541129] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.541582] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.541582] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.541777] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.541929] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.542218] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port a217e3f8-3ae9-4da9-9d28-54454f6094c1 not found, creating... [ 1085.542462] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.542634] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.542760] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.543072] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.543165] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.543580] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.543749] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.543864] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.544108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.544291] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.544505] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: a217e3f8-3ae9-4da9-9d28-54454f6094c1 is going to be created. [ 1085.580759] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.580994] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.581191] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.581461] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.581699] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.581925] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-a217e3f8-3ae9-4da9-9d28-54454f6094c1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.359943] env[65678]: INFO networking_nsxv3.common.synchronization [req-0f52e7f9-ffdd-442f-b925-b63b4c40e3c9 req-0729b224-5ce8-4c36-9d58-90cf11934d14 service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1086.359943] env[65678]: INFO networking_nsxv3.common.synchronization [req-0f52e7f9-ffdd-442f-b925-b63b4c40e3c9 req-0729b224-5ce8-4c36-9d58-90cf11934d14 service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1086.359943] env[65678]: INFO networking_nsxv3.common.synchronization [req-0f52e7f9-ffdd-442f-b925-b63b4c40e3c9 req-0729b224-5ce8-4c36-9d58-90cf11934d14 service nova] Enqueued Resource ID: a217e3f8-3ae9-4da9-9d28-54454f6094c1 with Priority: HIGHEST for action port [ 1086.360179] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1086.360815] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1086.360815] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a217e3f8-3ae9-4da9-9d28-54454f6094c1 with Priority: HIGHEST for action port [ 1086.360815] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.360815] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.361242] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.361242] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.361242] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.362571] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.362571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.362571] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-a217e3f8-3ae9-4da9-9d28-54454f6094c1 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.362571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a217e3f8-3ae9-4da9-9d28-54454f6094c1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.362571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a217e3f8-3ae9-4da9-9d28-54454f6094c1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.362977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a217e3f8-3ae9-4da9-9d28-54454f6094c1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.362977] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a217e3f8-3ae9-4da9-9d28-54454f6094c1',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.584371] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1086.584730] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.584912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.585265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.585557] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.585676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.585779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.585934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.586124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.586282] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.865106] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.865106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.865393] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a217e3f8-3ae9-4da9-9d28-54454f6094c1 with status ACTIVE [ 1086.865456] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.865575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.865640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.865861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.865968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.866206] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.866342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.866388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.866558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.866633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.866815] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.866997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.866997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.867184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.867220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.867291] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a217e3f8-3ae9-4da9-9d28-54454f6094c1 is going to be updated. [ 1086.896966] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.897195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.897236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.897457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.897605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.897770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a217e3f8-3ae9-4da9-9d28-54454f6094c1" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.088523] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.201144] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1087.201347] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1087.201470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.201635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.201888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.202125] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.202257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.202324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.202513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.202611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.202708] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.591766] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.704720] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.094305] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.094305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.094539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.094801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.094801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.094801] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1088.129834] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.129969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.133020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.140354] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1088.170116] env[65678]: INFO networking_nsxv3.common.synchronization [req-68946630-6201-4549-bdb9-0150381778b9 req-daebb8fe-8cd7-47e2-9b7c-721cc99a13fe tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1088.170793] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1088.171194] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.171343] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.171420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.171652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.171823] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.171942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.172041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.172232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.172292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.172400] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.207509] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.574504] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.574792] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.574915] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.575336] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.575714] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.575908] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.576085] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.576330] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.576534] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.576770] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.576900] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.577047] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.577167] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.577307] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1088.577437] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.577597] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.599573] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.599919] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1088.600105] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.600344] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.600714] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-905ae987-46b0-42e3-9125-2fffc5466a1e taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.600952] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-905ae987-46b0-42e3-9125-2fffc5466a1e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.601030] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-905ae987-46b0-42e3-9125-2fffc5466a1e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.601427] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-905ae987-46b0-42e3-9125-2fffc5466a1e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.601563] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('905ae987-46b0-42e3-9125-2fffc5466a1e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.674729] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.712054] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.712190] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.712263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.712519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.712625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.712730] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1088.744831] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.745024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.745063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.745313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.745705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.757199] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1089.105907] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.106230] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.106394] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.106765] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.107010] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.107248] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 905ae987-46b0-42e3-9125-2fffc5466a1e not found, creating... [ 1089.107618] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.107854] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.109033] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.109033] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.109139] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.109560] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.109743] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.109910] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.110246] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.110445] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.110659] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 905ae987-46b0-42e3-9125-2fffc5466a1e is going to be created. [ 1089.139575] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.139797] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.139908] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.140209] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.140436] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.140659] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-905ae987-46b0-42e3-9125-2fffc5466a1e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.177642] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.680566] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.680926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.680926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.681011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.681176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.681268] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1089.716618] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.716862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.716983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.717316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.717492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.728654] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1089.856161] env[65678]: INFO networking_nsxv3.common.synchronization [req-68946630-6201-4549-bdb9-0150381778b9 req-7a85b87b-8e19-4895-9844-948ecb73d4be service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1089.856340] env[65678]: INFO networking_nsxv3.common.synchronization [req-68946630-6201-4549-bdb9-0150381778b9 req-7a85b87b-8e19-4895-9844-948ecb73d4be service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1089.856474] env[65678]: INFO networking_nsxv3.common.synchronization [req-68946630-6201-4549-bdb9-0150381778b9 req-7a85b87b-8e19-4895-9844-948ecb73d4be service nova] Enqueued Resource ID: 905ae987-46b0-42e3-9125-2fffc5466a1e with Priority: HIGHEST for action port [ 1089.856953] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1089.857097] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1089.857192] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905ae987-46b0-42e3-9125-2fffc5466a1e with Priority: HIGHEST for action port [ 1089.857480] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.857600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.857682] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.857860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.857940] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.859108] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.859192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.859457] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-905ae987-46b0-42e3-9125-2fffc5466a1e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.859582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-905ae987-46b0-42e3-9125-2fffc5466a1e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.859647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-905ae987-46b0-42e3-9125-2fffc5466a1e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.859819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-905ae987-46b0-42e3-9125-2fffc5466a1e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.859895] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('905ae987-46b0-42e3-9125-2fffc5466a1e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.152947] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1090.153757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.153757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.153757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.153918] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.154062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.154162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.154332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.154413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.154496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.154663] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.154780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.154831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.154943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.155203] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.155317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.155436] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.155619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.155726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.155838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.155958] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.362778] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.362907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.363077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 905ae987-46b0-42e3-9125-2fffc5466a1e with status ACTIVE [ 1090.363242] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.363347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.363412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.363616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.363698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.363865] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.363949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.364024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.364189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.364266] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.364439] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.364745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.364745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.364745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.364949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.364949] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 905ae987-46b0-42e3-9125-2fffc5466a1e is going to be updated. [ 1090.387852] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.388038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.388124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.388289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.388426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.388605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-905ae987-46b0-42e3-9125-2fffc5466a1e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.658432] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ca02848-c142-45aa-adca-5a1d75fe5bb6: rpc.has_security_group_logging(os_id): False [ 1090.685337] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.685658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.685658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.685875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.686547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.686547] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.686547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.686547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.686722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.686783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.686969] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.687107] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.687138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.687367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.687435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.687614] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.687755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.687833] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.688067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.688398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.688398] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be created. [ 1090.691897] env[65678]: INFO networking_nsxv3.common.synchronization [None req-9379db1f-4b23-464d-828f-05ebf77d7d42 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_rules [ 1090.692469] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_rules [ 1090.692798] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-530d93d3-1148-4ef5-af5b-5267dece0166 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.692927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.692989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.693307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.693376] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.761249] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.761249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.761249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.761249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.761249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.775335] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1090.776073] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.776394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.776732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.777109] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.777272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.777371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.777586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.777688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.777803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.777930] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.798120] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1090.812648] env[65678]: INFO networking_nsxv3.common.synchronization [None req-af845d5b-b0a1-4943-86b5-fd740aa9dce2 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_rules [ 1090.813647] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_rules [ 1090.813860] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-530d93d3-1148-4ef5-af5b-5267dece0166 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.813960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.214303] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.214877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.214877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.215082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.215185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.215328] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 530d93d3-1148-4ef5-af5b-5267dece0166 already deleted. [ 1091.215387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.215545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.215715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.215800] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.282759] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.282984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.282984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.283247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.283457] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.283565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.283615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.284034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.284034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.284034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.284191] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.284279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.284327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.284465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.284604] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.284687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.284770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.284895] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.284972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.285404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.285404] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.737770] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.738093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.738093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.738210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.738210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.738291] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 530d93d3-1148-4ef5-af5b-5267dece0166 already deleted. [ 1091.738373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.739143] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1091.739505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.739976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.739976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.740167] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.740283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.740347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.740567] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.740664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.740777] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.788352] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50c43a13-ebd7-47b2-924e-039a5d7a4354: rpc.has_security_group_logging(os_id): False [ 1091.809047] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.809047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.809425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.809425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.809615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.809968] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.809968] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.810144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.810246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.810361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.810579] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.810705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.810797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.810983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.811096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.811323] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.811447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.811507] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.811698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.811778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.812166] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1091.888629] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.888629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.888629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.889165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.889503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.912311] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1092.243427] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.746842] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.815200] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1092.815420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.815625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.816221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.816523] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.868643] env[65678]: INFO networking_nsxv3.common.synchronization [req-fa26bbf2-fc5a-4553-bb22-73e8c3de42bc req-ecbbd975-803f-41bb-9e19-cb59accc1015 tempest-ListImageFiltersTestJSON-544928916 tempest-ListImageFiltersTestJSON-544928916-project-member] Enqueued Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1092.868985] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1092.869687] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.869687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.869687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.871501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.871501] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.871501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.871501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.871501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.871501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.871501] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.161718] env[65678]: INFO networking_nsxv3.common.synchronization [req-7846ca33-7004-45d8-af43-155e9b92f9b4 req-6a86a21a-233c-494c-a34a-df310f2569c1 tempest-MultipleCreateTestJSON-1045728445 tempest-MultipleCreateTestJSON-1045728445-project-member] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1093.162279] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1093.162579] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.163244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.163244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.163244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.163384] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.163501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.163651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.163806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.163907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.163998] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.251068] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.251249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.251315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.251548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.251635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.251733] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1093.282428] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.282608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.282653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.284310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.284310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.293920] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1093.305021] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.305271] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.305667] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.305727] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.305969] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.306329] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.306459] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.306680] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.306951] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.307140] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.307254] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.307367] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.307476] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.307605] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1093.307799] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.307884] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.320953] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.321229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.330340] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.330502] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1093.330731] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.330981] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.331442] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-115fe4c3-6193-4f18-a13f-c34ae59805b8 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.331728] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-115fe4c3-6193-4f18-a13f-c34ae59805b8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.331912] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-115fe4c3-6193-4f18-a13f-c34ae59805b8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.332391] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-115fe4c3-6193-4f18-a13f-c34ae59805b8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.332609] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('115fe4c3-6193-4f18-a13f-c34ae59805b8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.373753] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.373974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.374079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.374382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.374512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.374805] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.374960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.375101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.375380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.375528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.375674] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 already deleted. [ 1093.375809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.396254] env[65678]: INFO networking_nsxv3.common.synchronization [req-d47275ec-9cb1-4de0-ba94-efc066c17b18 req-5e22485a-be7e-401e-8164-652b5d5239cb tempest-MultipleCreateTestJSON-1045728445 tempest-MultipleCreateTestJSON-1045728445-project-member] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1093.397042] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1093.397494] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.397657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.666481] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.837487] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.838137] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.838369] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.839613] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.839613] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.839613] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 115fe4c3-6193-4f18-a13f-c34ae59805b8 not found, creating... [ 1093.839613] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.839613] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.840897] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.840897] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.840897] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.840897] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.840897] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.841541] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.841541] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.841541] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.841541] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 115fe4c3-6193-4f18-a13f-c34ae59805b8 is going to be created. [ 1093.866044] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.866646] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.866847] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.867475] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.867764] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.868015] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-115fe4c3-6193-4f18-a13f-c34ae59805b8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.932717] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1093.932901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.171881] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.608165] env[65678]: INFO networking_nsxv3.common.synchronization [req-fa26bbf2-fc5a-4553-bb22-73e8c3de42bc req-0a57587f-9525-4675-8d28-a7c5450162cb service nova] Enqueued Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_rules [ 1094.608283] env[65678]: INFO networking_nsxv3.common.synchronization [req-fa26bbf2-fc5a-4553-bb22-73e8c3de42bc req-0a57587f-9525-4675-8d28-a7c5450162cb service nova] Enqueued Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1094.608434] env[65678]: INFO networking_nsxv3.common.synchronization [req-fa26bbf2-fc5a-4553-bb22-73e8c3de42bc req-0a57587f-9525-4675-8d28-a7c5450162cb service nova] Enqueued Resource ID: 115fe4c3-6193-4f18-a13f-c34ae59805b8 with Priority: HIGHEST for action port [ 1094.608993] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_rules [ 1094.609313] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1094.609427] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 115fe4c3-6193-4f18-a13f-c34ae59805b8 with Priority: HIGHEST for action port [ 1094.609713] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.609840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.609952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.610204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.610306] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.611216] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.611327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.611327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.611486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.611628] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.611722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.611783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.611920] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.612078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.612144] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.613106] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-115fe4c3-6193-4f18-a13f-c34ae59805b8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.613542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-115fe4c3-6193-4f18-a13f-c34ae59805b8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.613542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-115fe4c3-6193-4f18-a13f-c34ae59805b8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.613542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-115fe4c3-6193-4f18-a13f-c34ae59805b8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.616821] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('115fe4c3-6193-4f18-a13f-c34ae59805b8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.674598] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.674922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.674922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.674975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.675086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.675154] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1094.705171] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.706063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.706063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.706063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.706063] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.716101] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1094.722774] env[65678]: INFO networking_nsxv3.common.synchronization [req-595d69ed-b8a4-4e41-b304-e25fe9720f60 req-1544c287-ff56-411c-a97a-06e6af6a5b57 tempest-ServersAdminTestJSON-1252313613 tempest-ServersAdminTestJSON-1252313613-project-member] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1094.723358] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1094.723661] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.724808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.724808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.724808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.724808] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.724808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.724808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.725064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.725064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.725064] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.119335] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.120408] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.120521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.120678] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 115fe4c3-6193-4f18-a13f-c34ae59805b8 with status ACTIVE [ 1095.120833] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.120936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.120999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.121216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.121303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.121467] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.121561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.121618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.122014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.123780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.123997] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.124142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.124173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.124330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.124403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.124485] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 115fe4c3-6193-4f18-a13f-c34ae59805b8 is going to be updated. [ 1095.152764] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.152947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.152992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.153858] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.153958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.154115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-115fe4c3-6193-4f18-a13f-c34ae59805b8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.228235] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.304945] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1095.305382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.306064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.306064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.306195] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.306256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.306331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.306602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.306762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.306884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.306994] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.626559] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.730904] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.812262] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.812262] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.812262] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.812262] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.812262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.812915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.812915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.812915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.812915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.812915] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.130681] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.131088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.131088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.131207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.131297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.131395] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 is going to be created. [ 1096.157559] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.157734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.157782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.158259] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.158259] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.170191] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: UNINITIALIZED for 2s [ 1096.234760] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.234955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.235054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.235278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.235494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.235553] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1096.277762] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.278021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.278155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.278477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.278727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.298970] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1096.315870] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79cab93f-aae5-467c-88f3-35382c30a4ef: rpc.has_security_group_logging(os_id): False [ 1096.344418] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.344596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.344629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.344834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.344921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.345163] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.345263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.345394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.345566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.345647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.345832] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.345927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.345988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.346148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.346428] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.346672] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.346792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.346862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.347031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.347120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.347211] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1096.425668] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.425668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.425668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.425668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.425668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.446201] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1096.731051] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1096.731278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.731463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.731846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.731951] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.732098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.732168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.732339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.732422] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.732506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.732694] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.736686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.737225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.738710] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.738710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.738710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.738710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.738710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.738710] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.241509] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.241884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.241927] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.242040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.242105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.242337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.242458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.242674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.242782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.242844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.243021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.243105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.243194] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1097.246544] env[65678]: INFO networking_nsxv3.common.synchronization [req-40d27109-02ef-40b9-8c58-38682b5bc7cb req-6ccfd984-5581-447a-83af-130784cbf2e3 tempest-ListImageFiltersTestJSON-544928916 tempest-ListImageFiltersTestJSON-544928916-project-member] Enqueued Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1097.247361] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1097.247452] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.247557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.278284] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.278458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.278528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.278725] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.278872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.292979] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1097.583509] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.584902] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.585062] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.585411] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.585775] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.585943] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.586124] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.586350] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.586497] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.586699] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.586812] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.586918] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.587035] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.587145] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.587249] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.587461] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.608820] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.608923] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1097.608996] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.609192] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-467" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.609542] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-b14d2c20-d041-40d2-a260-878598f16d21 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.610375] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-b14d2c20-d041-40d2-a260-878598f16d21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.610375] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-b14d2c20-d041-40d2-a260-878598f16d21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.610375] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-b14d2c20-d041-40d2-a260-878598f16d21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.610375] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b14d2c20-d041-40d2-a260-878598f16d21',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.113427] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.113697] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.113863] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.114174] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.114325] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.114498] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port b14d2c20-d041-40d2-a260-878598f16d21 not found, creating... [ 1098.114760] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.114915] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.115052] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.115336] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.115472] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.115772] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.115930] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.116059] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.116268] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.116401] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.116610] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: b14d2c20-d041-40d2-a260-878598f16d21 is going to be created. [ 1098.137243] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.137243] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.137453] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.137664] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.137890] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.138132] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-b14d2c20-d041-40d2-a260-878598f16d21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.180955] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: SUCCESS [ 1098.181185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.181370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.181615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.181809] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.181921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.181973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.182262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.182356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.182446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.182571] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.183424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.183581] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.184162] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.184162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.184162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.184162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.184162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.184407] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.310827] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1098.311125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.460305] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1098.460530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.686565] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.686565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.687494] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.888711] env[65678]: INFO networking_nsxv3.common.synchronization [req-40d27109-02ef-40b9-8c58-38682b5bc7cb req-88acf4af-75ee-4165-aaef-bcd212c9e59b service nova] Enqueued Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_rules [ 1098.888888] env[65678]: INFO networking_nsxv3.common.synchronization [req-40d27109-02ef-40b9-8c58-38682b5bc7cb req-88acf4af-75ee-4165-aaef-bcd212c9e59b service nova] Enqueued Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1098.889034] env[65678]: INFO networking_nsxv3.common.synchronization [req-40d27109-02ef-40b9-8c58-38682b5bc7cb req-88acf4af-75ee-4165-aaef-bcd212c9e59b service nova] Enqueued Resource ID: b14d2c20-d041-40d2-a260-878598f16d21 with Priority: HIGHEST for action port [ 1098.889632] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_rules [ 1098.889768] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1098.889865] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b14d2c20-d041-40d2-a260-878598f16d21 with Priority: HIGHEST for action port [ 1098.890170] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.890314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.890540] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.890628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.890926] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b14d2c20-d041-40d2-a260-878598f16d21 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.890926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b14d2c20-d041-40d2-a260-878598f16d21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.891082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b14d2c20-d041-40d2-a260-878598f16d21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.891202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b14d2c20-d041-40d2-a260-878598f16d21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.891323] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b14d2c20-d041-40d2-a260-878598f16d21',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.189800] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.310801] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1099.310997] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 deletion is rescheduled due to dependency. [ 1099.311246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.311316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.311542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.311826] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.311971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.312065] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.312258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.312349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.312445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.312640] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.312741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.312803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.312957] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.313119] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.313216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.313278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.313455] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.313530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.313611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.313703] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.393686] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b14d2c20-d041-40d2-a260-878598f16d21 with status ACTIVE [ 1099.394555] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.394555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.394555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.394555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.394555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.395602] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.395602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.395602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.395602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.395602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.395602] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.395602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.395602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.395602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.395889] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.395889] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b14d2c20-d041-40d2-a260-878598f16d21 is going to be updated. [ 1099.420114] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.420114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.420114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.420393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.420393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.420506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b14d2c20-d041-40d2-a260-878598f16d21" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.556192] env[65678]: INFO networking_nsxv3.common.synchronization [req-1663362c-451a-4bf6-b607-ec4a9fbd7e26 req-ea179159-1b19-4c7d-9a47-322bb330f0f3 tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1099.556872] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1099.557252] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.557381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.557449] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.557720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.557874] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.557973] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.558046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.558205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.558293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.558384] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.693042] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.693042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.693042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.693312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.693531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.693670] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 is going to be updated. [ 1099.725806] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.725948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.726051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.726243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.726407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.738033] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: IN_PROGRESS for 2s [ 1099.816449] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ca02848-c142-45aa-adca-5a1d75fe5bb6: rpc.has_security_group_logging(os_id): False [ 1099.837863] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.838105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.838105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.838316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.838409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.838606] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.838908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.838979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.839167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.839247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.839442] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.839538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.839602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.839743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.839816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.840040] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.840123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.840185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.840327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.840401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.840500] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1099.879541] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.879752] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.879875] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.880158] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.880411] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.880566] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.880683] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.880989] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.881153] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.881358] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.881471] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.881582] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.881688] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.881793] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.881896] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.882036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.912906] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.913099] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1099.913238] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.913436] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.913748] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.913919] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.914056] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.914405] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.914543] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('412ab9e4-ab4a-4bf8-86c1-6db2047f3993',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.917481] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.917627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.917712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.917962] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.918123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.938859] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1100.062028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.062239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.062324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.062552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.062651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.062853] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.062952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.063028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.063188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.063270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.063366] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1100.107418] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.107565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.107629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.107814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.107947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.118926] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1100.416821] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.417272] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.417272] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.417486] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.417656] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.417813] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 412ab9e4-ab4a-4bf8-86c1-6db2047f3993 not found, creating... [ 1100.418103] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.418277] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.418413] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.418659] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.418815] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.419136] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.419293] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.419424] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.419658] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.419793] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.419944] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 412ab9e4-ab4a-4bf8-86c1-6db2047f3993 is going to be created. [ 1100.450467] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.451063] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.451133] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.451498] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.451835] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.452211] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.796117] env[65678]: INFO networking_nsxv3.common.synchronization [req-c8323f9f-54c2-45b2-adb2-ea124fe3384f req-b2946a89-4571-41d6-883f-1d69271fb8d2 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1100.797417] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1100.797817] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.798018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.798153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.798420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.798578] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.798680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.798744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.799121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.799121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.799121] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.203306] env[65678]: INFO networking_nsxv3.common.synchronization [req-1663362c-451a-4bf6-b607-ec4a9fbd7e26 req-73cf3905-e332-4766-bf56-4979b7022c8c service nova] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 1101.203306] env[65678]: INFO networking_nsxv3.common.synchronization [req-1663362c-451a-4bf6-b607-ec4a9fbd7e26 req-73cf3905-e332-4766-bf56-4979b7022c8c service nova] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1101.203306] env[65678]: INFO networking_nsxv3.common.synchronization [req-1663362c-451a-4bf6-b607-ec4a9fbd7e26 req-73cf3905-e332-4766-bf56-4979b7022c8c service nova] Enqueued Resource ID: 412ab9e4-ab4a-4bf8-86c1-6db2047f3993 with Priority: HIGHEST for action port [ 1101.203306] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 1101.203306] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1101.203306] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 412ab9e4-ab4a-4bf8-86c1-6db2047f3993 with Priority: HIGHEST for action port [ 1101.203306] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.203306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.203306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.203306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.203306] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.204448] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.204574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.204789] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.205300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.205300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.205300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.205300] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('412ab9e4-ab4a-4bf8-86c1-6db2047f3993',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.301873] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.707015] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.707389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.707389] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 412ab9e4-ab4a-4bf8-86c1-6db2047f3993 with status ACTIVE [ 1101.707525] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.707635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.707723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.707922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.708024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.708217] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.708302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.708365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.708528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.708615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.708790] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.708884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.708979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.709105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.709178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.709262] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 412ab9e4-ab4a-4bf8-86c1-6db2047f3993 is going to be updated. [ 1101.736293] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.736465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.736546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.736800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.736976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.737162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-412ab9e4-ab4a-4bf8-86c1-6db2047f3993" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.746869] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: SUCCESS [ 1101.747015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.747193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.747418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.747652] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.747771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.748799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.748799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.748799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.748799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.748799] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.748799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.748799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.748799] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.748799] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.749144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.749144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.749262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.749357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.749442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.749530] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.750377] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.750544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.750697] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.750797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.750859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.750998] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.751088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.751174] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.804033] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.953914] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1101.954169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.129449] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1102.129634] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 deletion is rescheduled due to dependency. [ 1102.129746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.129906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.130209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.130397] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.130518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.130585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.130769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.130855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.131314] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.253878] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c6b2ecc-4e9d-4daa-827c-44b5af68a366: rpc.has_security_group_logging(os_id): False [ 1102.255273] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.274158] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.274309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.275613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.275613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.275613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.275613] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.275613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.275613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.275613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.275613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.275613] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.275993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.275993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.275993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.275993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.276172] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.276220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.276276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.276410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.276487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.276594] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 is going to be created. [ 1102.307033] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.307257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.307356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.307614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.307712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.307823] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1102.341484] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.341661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.341767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.341976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.342177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.352775] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1102.361358] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.361358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.361549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.361636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.361869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.374529] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: IN_PROGRESS for 2s [ 1102.633146] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.759030] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.135878] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.260189] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.261098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.261098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.261098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.261098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.261098] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 is going to be updated. [ 1103.299137] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.299279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.299355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.299579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.299727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.315361] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: IN_PROGRESS for 2s [ 1103.640427] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.640427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.640427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.640427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.640427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.640427] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1103.677312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.677556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.677556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.677744] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.677890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.688457] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1103.968241] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.968509] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.968580] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.968971] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.969327] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.969543] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.969714] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.969997] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.970222] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.970500] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1103.970684] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.970842] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.971100] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.971793] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1103.971793] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.971793] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.001104] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.001321] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1104.001460] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.001636] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.002148] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-3c42d36c-172c-47fa-bcd0-f30975291ab7 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.002290] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.002343] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.002651] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.002787] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c42d36c-172c-47fa-bcd0-f30975291ab7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.366293] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1104.366293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.386960] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: SUCCESS [ 1104.387255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.387457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.387692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.387810] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.505569] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.505789] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.505789] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.506979] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.506979] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.506979] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 3c42d36c-172c-47fa-bcd0-f30975291ab7 not found, creating... [ 1104.506979] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.506979] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.506979] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.507295] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.507338] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.507709] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.507894] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.507894] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.508122] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.508260] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.508394] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 3c42d36c-172c-47fa-bcd0-f30975291ab7 is going to be created. [ 1104.534043] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.534043] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.534307] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.534423] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.534649] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.534951] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.890703] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.890788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.223878] env[65678]: INFO networking_nsxv3.common.synchronization [req-bd13e070-b97a-4f68-a9aa-00fc26abd7a1 req-a1299627-41e2-4c34-a0ae-8fd5fbefde46 service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 1105.224165] env[65678]: INFO networking_nsxv3.common.synchronization [req-bd13e070-b97a-4f68-a9aa-00fc26abd7a1 req-a1299627-41e2-4c34-a0ae-8fd5fbefde46 service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 1105.224474] env[65678]: INFO networking_nsxv3.common.synchronization [req-bd13e070-b97a-4f68-a9aa-00fc26abd7a1 req-a1299627-41e2-4c34-a0ae-8fd5fbefde46 service nova] Enqueued Resource ID: 3c42d36c-172c-47fa-bcd0-f30975291ab7 with Priority: HIGHEST for action port [ 1105.225171] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 1105.225335] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 1105.225441] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c42d36c-172c-47fa-bcd0-f30975291ab7 with Priority: HIGHEST for action port [ 1105.225769] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.225929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.225929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.226166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.226245] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.227198] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.227826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.227911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.228149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.228312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.228409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.228493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.228669] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.228762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.228856] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.230025] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c42d36c-172c-47fa-bcd0-f30975291ab7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.230179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.230247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.233220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.233220] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c42d36c-172c-47fa-bcd0-f30975291ab7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.327023] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: SUCCESS [ 1105.327023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.327023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.327023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.327023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.327023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.327023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.327023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.327023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.327023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.327023] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.703880] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1105.704132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.704378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.704683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.704835] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.704985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.705108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.705274] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.705376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.705514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.705743] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.732511] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.733898] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.734058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.734179] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c42d36c-172c-47fa-bcd0-f30975291ab7 with status ACTIVE [ 1105.734338] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.734445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.734508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.734711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.734822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.736036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.736036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.736036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.736036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.736036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.736036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.736036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.736036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.736036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.736036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.736036] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c42d36c-172c-47fa-bcd0-f30975291ab7 is going to be updated. [ 1105.758919] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.759164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.759164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.759387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.759529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.759714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.828659] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.828875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.828955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.829197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.829396] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.829475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.829532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.829684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.829773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.829861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.830016] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.830117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.830178] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.830345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.830489] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.830580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.830643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.830997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.831113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.831154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.831227] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.208713] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.238061] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.334919] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c6b2ecc-4e9d-4daa-827c-44b5af68a366: rpc.has_security_group_logging(os_id): False [ 1106.354643] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.354812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.354876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.355209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.355368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.355803] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.355925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.355993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.356193] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.356276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.356476] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.356590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.356646] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.356825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.356903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.357103] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.357222] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.357306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.357473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.357548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.357639] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 is going to be updated. [ 1106.422731] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.422908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.422948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.423253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.423438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.438965] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: IN_PROGRESS for 2s [ 1106.661146] env[65678]: INFO networking_nsxv3.common.synchronization [req-b2048181-6bf7-4502-832d-5399eaa7dbaf req-d46f05a9-46b4-4226-aa6a-e3b582a353b2 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_members [ 1106.661723] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_members [ 1106.662176] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-530d93d3-1148-4ef5-af5b-5267dece0166 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.662328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.662400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.662680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.662868] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.662972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.663076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.663245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.663331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.663441] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.711234] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9844dc2-a792-4762-9b70-e918899f67f5: rpc.has_security_group_logging(os_id): False [ 1106.733417] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.733672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.733862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.734206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.734266] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.734618] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.734798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.734887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.735171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.735291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.735456] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1106.740313] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.740486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.740558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.740767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.740866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.741153] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 1106.775841] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.776102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.776267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.776681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.776879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.791806] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 1106.821685] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.821917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.822863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.822863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.822863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.835902] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1107.048074] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.048074] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.048074] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.048074] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.048074] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.048074] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.048567] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.048567] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.048768] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.049104] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.049229] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.049347] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.049513] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.049639] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.049752] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.049902] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.074712] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.074962] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.075069] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.075189] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-834" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.075523] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-134dd4ac-5437-4799-91fc-1d66d1bafe69 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.075858] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-134dd4ac-5437-4799-91fc-1d66d1bafe69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.076049] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-134dd4ac-5437-4799-91fc-1d66d1bafe69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.076418] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-134dd4ac-5437-4799-91fc-1d66d1bafe69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.076717] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('134dd4ac-5437-4799-91fc-1d66d1bafe69',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.165953] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.166204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.166307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.166618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.166771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.167481] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.167703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.167778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.168052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.168153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.168267] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530d93d3-1148-4ef5-af5b-5267dece0166 already deleted. [ 1107.168364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.579758] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.580091] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.580232] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.580564] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.580730] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.580895] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 134dd4ac-5437-4799-91fc-1d66d1bafe69 not found, creating... [ 1107.581202] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.581360] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.581519] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.581769] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.581902] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.582253] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.582411] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.582529] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.582738] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.582874] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.583104] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 134dd4ac-5437-4799-91fc-1d66d1bafe69 is going to be created. [ 1107.606983] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.607178] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.607301] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.607562] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.607856] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.608109] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-134dd4ac-5437-4799-91fc-1d66d1bafe69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.330853] env[65678]: INFO networking_nsxv3.common.synchronization [req-b2048181-6bf7-4502-832d-5399eaa7dbaf req-d29d264b-6060-423c-8451-d2beab8e2102 service nova] Enqueued Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_rules [ 1108.330853] env[65678]: INFO networking_nsxv3.common.synchronization [req-b2048181-6bf7-4502-832d-5399eaa7dbaf req-d29d264b-6060-423c-8451-d2beab8e2102 service nova] Enqueued Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_members [ 1108.330853] env[65678]: INFO networking_nsxv3.common.synchronization [req-b2048181-6bf7-4502-832d-5399eaa7dbaf req-d29d264b-6060-423c-8451-d2beab8e2102 service nova] Enqueued Resource ID: 134dd4ac-5437-4799-91fc-1d66d1bafe69 with Priority: HIGHEST for action port [ 1108.332105] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_rules [ 1108.332848] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_members [ 1108.332848] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134dd4ac-5437-4799-91fc-1d66d1bafe69 with Priority: HIGHEST for action port [ 1108.333115] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-530d93d3-1148-4ef5-af5b-5267dece0166 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.333321] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.333423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.333701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.333824] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.334904] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-530d93d3-1148-4ef5-af5b-5267dece0166 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.335275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.335385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.335601] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.335800] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.335942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.336030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.336211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.336336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.336457] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.337632] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-134dd4ac-5437-4799-91fc-1d66d1bafe69 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.337791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-134dd4ac-5437-4799-91fc-1d66d1bafe69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.337890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-134dd4ac-5437-4799-91fc-1d66d1bafe69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.338087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-134dd4ac-5437-4799-91fc-1d66d1bafe69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.338190] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('134dd4ac-5437-4799-91fc-1d66d1bafe69',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.454975] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: SUCCESS [ 1108.455270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.802537] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 1108.802848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.803420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.803420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.803542] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.803612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.803676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.803839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.803924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.804015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.804114] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.840135] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-530d93d3-1148-4ef5-af5b-5267dece0166 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.840270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.840454] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.842177] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 134dd4ac-5437-4799-91fc-1d66d1bafe69 with status ACTIVE [ 1108.842177] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.842177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.842177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.842355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.842355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.842536] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.842631] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.842692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.842840] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.842915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.844013] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.844138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.844213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.844399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.844483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.844573] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 134dd4ac-5437-4799-91fc-1d66d1bafe69 is going to be updated. [ 1108.851458] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1108.851458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.868757] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.868870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.868935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.869134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.869268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.869416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-134dd4ac-5437-4799-91fc-1d66d1bafe69" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.306370] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.306550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.306621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.306911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.307111] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.307257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.307289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.307456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.307549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.307642] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.307805] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.307899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.307965] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.308121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.308274] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.308380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.308765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.308765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.308765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.308765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.308959] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.346838] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.813039] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02e933d1-ac0d-4baa-9da0-e149762ce926: rpc.has_security_group_logging(os_id): False [ 1109.833287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.833463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.833547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.833776] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.833874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.834122] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.834225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.834283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.834436] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.834512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.834716] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.834847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.834921] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.836170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.836317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.836473] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.836574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.836641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.836804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.836882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.836971] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be created. [ 1109.850014] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.850288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.850424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.850651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.850786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.850925] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530d93d3-1148-4ef5-af5b-5267dece0166 is going to be created. [ 1109.877881] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.877881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.877881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.877881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.877881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.887916] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530d93d3-1148-4ef5-af5b-5267dece0166 in Status: UNINITIALIZED for 2s [ 1109.906922] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.907060] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.907122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.907302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.907481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.919118] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 1111.899436] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530d93d3-1148-4ef5-af5b-5267dece0166 in Status: SUCCESS [ 1111.899689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.899861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.900105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.900320] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.900441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.900508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.900668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.900752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.900838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.900933] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.934033] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 1111.934342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.403501] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.874800] env[65678]: INFO networking_nsxv3.common.synchronization [req-ec64e460-3cfb-4846-a7bd-aed2b1bfa90b req-ad354c92-f114-4949-a7ad-e5b0d8506431 tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 1112.875441] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 1112.875798] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.875937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.876171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.876394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.876573] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.876686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.876757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.876960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.877086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.877543] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.908284] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 530d93d3-1148-4ef5-af5b-5267dece0166: rpc.has_security_group_logging(os_id): False [ 1112.927025] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.927025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.927025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.927025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.927025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.927025] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.927025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.927025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.927025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.927025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.927025] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 530d93d3-1148-4ef5-af5b-5267dece0166 is going to be created. [ 1113.005628] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.005792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.005861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.006619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.006619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.021873] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 530d93d3-1148-4ef5-af5b-5267dece0166 in Status: IN_PROGRESS for 2s [ 1113.283682] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.283957] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.284152] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.284481] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.284807] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.285218] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.285365] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.285647] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.285878] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.286155] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.286281] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.286379] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.286487] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.286642] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.286798] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.286947] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.307998] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.308240] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1113.308389] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.308558] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-770" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.308941] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-1a9f0741-167c-4d22-8152-6a49722019e7 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.309164] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-1a9f0741-167c-4d22-8152-6a49722019e7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.309300] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-1a9f0741-167c-4d22-8152-6a49722019e7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.309676] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-1a9f0741-167c-4d22-8152-6a49722019e7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.309845] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a9f0741-167c-4d22-8152-6a49722019e7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.379414] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.812755] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.813080] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.813284] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.813625] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.813844] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.814077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 1a9f0741-167c-4d22-8152-6a49722019e7 not found, creating... [ 1113.814403] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.814625] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.814802] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.815146] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.815296] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.815585] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.815742] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.815893] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.816123] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.816259] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.816397] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 1a9f0741-167c-4d22-8152-6a49722019e7 is going to be created. [ 1113.836883] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.837144] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.837275] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.837557] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.837780] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.838011] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-1a9f0741-167c-4d22-8152-6a49722019e7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.881657] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.384450] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.384720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.384936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.385872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.385872] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.385872] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 is going to be updated. [ 1114.415182] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.415384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.415416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.415609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.415757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.426397] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: IN_PROGRESS for 2s [ 1114.587965] env[65678]: INFO networking_nsxv3.common.synchronization [req-ec64e460-3cfb-4846-a7bd-aed2b1bfa90b req-b9ab663e-399e-4bb3-9d25-d385d7feb572 service nova] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_rules [ 1114.588189] env[65678]: INFO networking_nsxv3.common.synchronization [req-ec64e460-3cfb-4846-a7bd-aed2b1bfa90b req-b9ab663e-399e-4bb3-9d25-d385d7feb572 service nova] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 1114.588330] env[65678]: INFO networking_nsxv3.common.synchronization [req-ec64e460-3cfb-4846-a7bd-aed2b1bfa90b req-b9ab663e-399e-4bb3-9d25-d385d7feb572 service nova] Enqueued Resource ID: 1a9f0741-167c-4d22-8152-6a49722019e7 with Priority: HIGHEST for action port [ 1114.588841] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_rules [ 1114.589011] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 1114.589137] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a9f0741-167c-4d22-8152-6a49722019e7 with Priority: HIGHEST for action port [ 1114.589427] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.589544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.589608] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.589847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.589993] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.590728] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.590828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.591073] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a9f0741-167c-4d22-8152-6a49722019e7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.591164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a9f0741-167c-4d22-8152-6a49722019e7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.591236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a9f0741-167c-4d22-8152-6a49722019e7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.591403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a9f0741-167c-4d22-8152-6a49722019e7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.591476] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a9f0741-167c-4d22-8152-6a49722019e7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.037415] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 530d93d3-1148-4ef5-af5b-5267dece0166 in Status: SUCCESS [ 1115.037638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.094479] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a9f0741-167c-4d22-8152-6a49722019e7 with status ACTIVE [ 1115.094721] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.094869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.094969] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.095874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.095874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.095874] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.095874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.095874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.096120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.096120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.096225] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.096275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.096323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.096465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.096543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.096826] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a9f0741-167c-4d22-8152-6a49722019e7 is going to be updated. [ 1115.097869] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.097986] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.121846] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.122041] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.122080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.122276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.122412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.122578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a9f0741-167c-4d22-8152-6a49722019e7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.440460] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: SUCCESS [ 1116.440460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.440460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.440888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.440888] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.440888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.441027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.441210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.441312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.441478] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.944478] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.959951] env[65678]: INFO networking_nsxv3.common.synchronization [req-73d76814-1729-4ef5-b52c-86cd8529d9e8 req-235c0165-f8ad-4669-9877-b73212bc3b91 tempest-ServersAdminTestJSON-1252313613 tempest-ServersAdminTestJSON-1252313613-project-member] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1116.960536] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1116.960857] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.961349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.961349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.961349] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.961595] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.961595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.961595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.961765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.961854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.961985] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.447080] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.466262] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.949261] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.949470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.949553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.949770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.949870] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.950045] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 is going to be updated. [ 1117.969292] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.984545] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.984770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.984770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.984958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.985129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.998396] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: IN_PROGRESS for 2s [ 1118.473423] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.473764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.473764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.473937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.474057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.474312] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1118.506702] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.506880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.506926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.507163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.507466] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.521838] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1118.739743] env[65678]: INFO networking_nsxv3.common.synchronization [req-f8029b57-2e4e-47c1-a905-415434a31f8e req-db30c9ba-de16-41f7-b02e-344341476c0e tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1118.741967] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1118.742151] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.743067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.743684] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.743880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.744079] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.744233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.744287] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.744435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.744530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.744651] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.247988] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.750146] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.011233] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: SUCCESS [ 1120.011481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.011978] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.012276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.012505] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.012627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.012761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.012955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.012997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.013097] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.013225] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.252779] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.252995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.253072] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.253259] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.253363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.253449] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1120.283968] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.284162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.284206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.284412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.284566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.294679] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1120.516686] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.533227] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1120.533551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.776274] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-544 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.776274] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.776274] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.776274] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.776274] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.776274] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.776913] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.777306] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.777581] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.777891] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.778181] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.778430] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.778643] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.778873] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.779119] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.779375] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.801966] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.802899] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.802899] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.803105] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-544" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.803598] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-648de54a-548a-4832-baa5-1b119645747e taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.804390] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.804390] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.804390] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.804781] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('648de54a-548a-4832-baa5-1b119645747e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.023864] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 961e8451-f48b-412a-8046-631c24d72fe5: rpc.has_security_group_logging(os_id): False [ 1121.045110] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.045110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.045110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.045110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.045110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.045110] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.045110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.045110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.045110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.045110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.045110] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 is going to be updated. [ 1121.114022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.114022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.114022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.114022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.114022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.125503] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: IN_PROGRESS for 2s [ 1121.309108] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.309108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.309108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.309108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.309108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.309108] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.309108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.309108] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.309553] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.309659] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.309983] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.310312] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.310477] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.310731] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.310906] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.311095] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 648de54a-548a-4832-baa5-1b119645747e is going to be updated. [ 1121.345421] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.345668] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.345745] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.346087] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.346296] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.346527] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.076571] env[65678]: INFO networking_nsxv3.common.synchronization [req-9e71fee8-69fd-456c-8fdf-9505a37c1b8a req-6986fa9b-d330-4bd7-9afa-c573a9b47f4e service nova] Enqueued Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_rules [ 1122.076825] env[65678]: INFO networking_nsxv3.common.synchronization [req-9e71fee8-69fd-456c-8fdf-9505a37c1b8a req-6986fa9b-d330-4bd7-9afa-c573a9b47f4e service nova] Enqueued Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_members [ 1122.076825] env[65678]: INFO networking_nsxv3.common.synchronization [req-9e71fee8-69fd-456c-8fdf-9505a37c1b8a req-6986fa9b-d330-4bd7-9afa-c573a9b47f4e service nova] Enqueued Resource ID: 648de54a-548a-4832-baa5-1b119645747e with Priority: HIGHEST for action port [ 1122.077416] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_rules [ 1122.077559] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_members [ 1122.077685] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 648de54a-548a-4832-baa5-1b119645747e with Priority: HIGHEST for action port [ 1122.078011] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.080528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.080837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.081169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.081291] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.082801] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.082942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.083044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.083261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.083423] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.083522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.083614] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.083764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.084382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.087384] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.088493] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-648de54a-548a-4832-baa5-1b119645747e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.089198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.089398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.092819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.092819] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('648de54a-548a-4832-baa5-1b119645747e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.292216] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.292430] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.292531] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.293406] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.293406] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.293406] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.293406] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.294125] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.294125] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.294125] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.294125] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.294368] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.294368] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.294438] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.294517] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.294650] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.308390] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1122.308390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.321644] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.321644] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.321644] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.321644] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-690" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.321644] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-3c42d36c-172c-47fa-bcd0-f30975291ab7 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.321644] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.321644] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.321644] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.321644] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c42d36c-172c-47fa-bcd0-f30975291ab7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.593742] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.594999] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.594999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.595167] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 648de54a-548a-4832-baa5-1b119645747e with status ACTIVE [ 1122.595363] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.595488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.595558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.596247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.596247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.596247] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.596401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.596401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.596517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.596604] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.597238] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.597238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.597238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.597238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.597504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.597504] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 648de54a-548a-4832-baa5-1b119645747e is going to be updated. [ 1122.622674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.622858] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.622897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.623093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.623253] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.623421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-648de54a-548a-4832-baa5-1b119645747e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.824693] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.824693] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.824968] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.825272] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.825520] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.825864] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.826044] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.826196] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.826427] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.826566] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.826874] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.827093] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.827174] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.827399] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.827546] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.827685] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 3c42d36c-172c-47fa-bcd0-f30975291ab7 is going to be updated. [ 1122.854624] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.854624] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.854624] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.854624] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.854624] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.854959] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.096188] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.139094] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: SUCCESS [ 1123.139288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.572030] env[65678]: INFO networking_nsxv3.common.synchronization [req-b676bbb9-822f-4875-a653-afb785561bee req-3fa75f19-03f8-49c9-8b23-8a8916a4a16f service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 1123.572030] env[65678]: INFO networking_nsxv3.common.synchronization [req-b676bbb9-822f-4875-a653-afb785561bee req-3fa75f19-03f8-49c9-8b23-8a8916a4a16f service nova] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 1123.572030] env[65678]: INFO networking_nsxv3.common.synchronization [req-b676bbb9-822f-4875-a653-afb785561bee req-3fa75f19-03f8-49c9-8b23-8a8916a4a16f service nova] Enqueued Resource ID: 3c42d36c-172c-47fa-bcd0-f30975291ab7 with Priority: HIGHEST for action port [ 1123.572030] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_rules [ 1123.572030] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 1123.572630] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c42d36c-172c-47fa-bcd0-f30975291ab7 with Priority: HIGHEST for action port [ 1123.573069] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.574076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.574076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.574076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.574076] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.575114] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.575470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.575635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.577118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.577118] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.577118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.577118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.577118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.577118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.577118] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.577886] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c42d36c-172c-47fa-bcd0-f30975291ab7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.579741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.579741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.579741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.579741] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c42d36c-172c-47fa-bcd0-f30975291ab7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.600751] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.600751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.600751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.600751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.600751] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.600751] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b06f75c-4a15-46fd-8850-579c633c71af is going to be updated. [ 1123.634148] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.634148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.634148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.634808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.635120] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.647098] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: IN_PROGRESS for 2s [ 1123.831149] env[65678]: INFO networking_nsxv3.common.synchronization [req-a161a11c-116c-4fb4-a6ba-ed0c26e21ea7 req-a021a973-14b9-4979-b15b-1396f807395a tempest-MultipleCreateTestJSON-1045728445 tempest-MultipleCreateTestJSON-1045728445-project-member] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1123.831149] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1123.831149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.831149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.831149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.831149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.831149] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.831149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.831149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.832153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.832374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.832583] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.079248] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.080580] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.080696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.080863] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c42d36c-172c-47fa-bcd0-f30975291ab7 with status ACTIVE [ 1124.081032] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.081138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.081206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.081421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.081510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.081679] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.081774] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.081836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.082049] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.082132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.082312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.082427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.082480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.082618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.082676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.082761] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c42d36c-172c-47fa-bcd0-f30975291ab7 is going to be updated. [ 1124.105926] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.107699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.107699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.107699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.107699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.107699] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c42d36c-172c-47fa-bcd0-f30975291ab7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.260070] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.260070] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.260070] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.260070] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.260496] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.260876] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.261132] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.261500] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.261759] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.262103] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.262330] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.263017] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.263017] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.263017] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.263017] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.263017] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.283610] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.283924] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1124.284169] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.284369] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.284867] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.285131] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.285272] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.285796] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.285970] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a23eb5c-d9e0-4de1-8cc7-be152062ff1a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.335229] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.335447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.335447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.335589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.335695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.335889] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.335989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.336138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.336333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.336408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.336498] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1124.366909] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.367169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.367169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.367408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.367550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.378111] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1124.584453] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.788393] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.788616] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.788771] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.790605] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.790605] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.790605] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 0a23eb5c-d9e0-4de1-8cc7-be152062ff1a not found, creating... [ 1124.790605] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.790605] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.790605] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.790910] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.790910] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.791091] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.791440] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.791596] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.791807] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.791935] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.792088] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 0a23eb5c-d9e0-4de1-8cc7-be152062ff1a is going to be created. [ 1124.820854] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.820854] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.820854] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.820854] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.820854] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.821301] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.086850] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.086850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.086850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.087147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.087180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.087399] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 1125.125046] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.125440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.125440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.125508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.125734] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.135724] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 1125.528807] env[65678]: INFO networking_nsxv3.common.synchronization [req-a161a11c-116c-4fb4-a6ba-ed0c26e21ea7 req-8b4084b5-7e79-4437-b14c-eef84f205adf service nova] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_rules [ 1125.528971] env[65678]: INFO networking_nsxv3.common.synchronization [req-a161a11c-116c-4fb4-a6ba-ed0c26e21ea7 req-8b4084b5-7e79-4437-b14c-eef84f205adf service nova] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1125.529139] env[65678]: INFO networking_nsxv3.common.synchronization [req-a161a11c-116c-4fb4-a6ba-ed0c26e21ea7 req-8b4084b5-7e79-4437-b14c-eef84f205adf service nova] Enqueued Resource ID: 0a23eb5c-d9e0-4de1-8cc7-be152062ff1a with Priority: HIGHEST for action port [ 1125.529698] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_rules [ 1125.529858] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1125.529969] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a23eb5c-d9e0-4de1-8cc7-be152062ff1a with Priority: HIGHEST for action port [ 1125.530398] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.530506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.530597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.530821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.530913] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.533384] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.533490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.533720] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.533831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.533918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.534252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.534396] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a23eb5c-d9e0-4de1-8cc7-be152062ff1a',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.662015] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: SUCCESS [ 1125.662290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.662537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.664037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.664037] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.664037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.664037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.664037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.664037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.664037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.664037] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.034577] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.034796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.038161] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a23eb5c-d9e0-4de1-8cc7-be152062ff1a with status ACTIVE [ 1126.038422] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.038633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.038708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.039019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.039127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.039319] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.039490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.039611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.039854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.039985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.040550] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.040550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.040550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.040821] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.040913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.041077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a23eb5c-d9e0-4de1-8cc7-be152062ff1a is going to be updated. [ 1126.066171] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.066347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.066415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.066632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.066768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.066944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a23eb5c-d9e0-4de1-8cc7-be152062ff1a" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.161604] env[65678]: INFO networking_nsxv3.common.synchronization [req-a161a11c-116c-4fb4-a6ba-ed0c26e21ea7 req-94b45781-f944-4366-a818-5edf9092279d tempest-MultipleCreateTestJSON-1045728445 tempest-MultipleCreateTestJSON-1045728445-project-member] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1126.162085] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1126.162432] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.162577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.165427] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.393165] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1126.393498] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 deletion is rescheduled due to dependency. [ 1126.393633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.393810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.394054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.394326] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.394447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.394511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.394675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.394758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.394857] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.485242] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.485517] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.485658] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.485930] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.486231] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.486398] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.486518] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.486729] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.486872] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.487087] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.487201] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.487309] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.487422] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.487520] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.487625] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.487754] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.506576] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.506782] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1126.506947] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.507201] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-561" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.507595] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.507810] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.507966] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.508340] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.508478] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.669234] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b06f75c-4a15-46fd-8850-579c633c71af: rpc.has_security_group_logging(os_id): False [ 1126.698513] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.698513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.698513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.698513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.730982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.730982] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.730982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.730982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.730982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.730982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.730982] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b06f75c-4a15-46fd-8850-579c633c71af is going to be updated. [ 1126.791160] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.791303] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.791372] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.791882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.791882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.809799] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: IN_PROGRESS for 2s [ 1126.896748] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.017374] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.017374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.017374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.017374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.017374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.017374] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364 not found, creating... [ 1127.017374] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.017374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.017374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.017374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.017374] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.018250] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.018527] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.018745] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.019122] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.019383] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.019706] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364 is going to be created. [ 1127.051439] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.051642] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.051804] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.052075] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.052312] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.052587] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.149108] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 1127.149108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.149108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.149653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.149653] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.149653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.149653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.149914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.149914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.150026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.150088] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.400118] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.658036] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.658247] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.658356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.658667] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.658886] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.659246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.659246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.659476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.659675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.659778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.659965] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.660102] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.660169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.660330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.660495] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.660615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.660676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.662777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.662909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.663053] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.663138] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.787227] env[65678]: INFO networking_nsxv3.common.synchronization [req-a161a11c-116c-4fb4-a6ba-ed0c26e21ea7 req-0ca46489-db26-4a27-9827-9901e5f0334a service nova] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_rules [ 1127.787465] env[65678]: INFO networking_nsxv3.common.synchronization [req-a161a11c-116c-4fb4-a6ba-ed0c26e21ea7 req-0ca46489-db26-4a27-9827-9901e5f0334a service nova] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1127.787617] env[65678]: INFO networking_nsxv3.common.synchronization [req-a161a11c-116c-4fb4-a6ba-ed0c26e21ea7 req-0ca46489-db26-4a27-9827-9901e5f0334a service nova] Enqueued Resource ID: a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364 with Priority: HIGHEST for action port [ 1127.788175] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_rules [ 1127.788322] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1127.789304] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364 with Priority: HIGHEST for action port [ 1127.789627] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.789867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.790158] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.790252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.790425] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.790531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.790587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.790794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.790869] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.904213] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.904428] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.904517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.904777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.904911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.905099] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1127.944920] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.945156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.945156] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.945364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.945510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.955742] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1128.166829] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02e933d1-ac0d-4baa-9da0-e149762ce926: rpc.has_security_group_logging(os_id): False [ 1128.189069] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.189069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.189069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.189069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.189069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.189069] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.189069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.189069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.189069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.189069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.189600] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.189600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.189600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.189600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.189600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.189812] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.189863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.189967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.190078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.190152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.190234] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 1128.259899] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.260166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.260166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.260914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.260914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.279663] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 1128.294327] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364 with status ACTIVE [ 1128.294746] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.294990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.295165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.295525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.295753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.296019] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.296220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.296339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.296585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.296918] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.297094] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.297270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.297473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.297653] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.297946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.298117] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364 is going to be updated. [ 1128.336043] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.336302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.336539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.336852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.337023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.337348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8e0f1e2-d5d9-444e-98f2-e42fb7cb0364" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.825892] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: SUCCESS [ 1128.826317] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.067496] env[65678]: INFO networking_nsxv3.common.synchronization [req-67a1218c-2e1e-498a-b9bf-8328745497d6 req-fca86663-9f54-4509-b7cc-ee4fdfb11b8d tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1129.068057] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1129.071461] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.071461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.071461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.071461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.071461] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.071461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.071461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.071461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.071461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.071461] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.572144] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.572370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.572452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.572688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.572783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.572992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.573280] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.573379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.573545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.573624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.573802] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1129.608994] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.609164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.609238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.609517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.609747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.622959] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1129.968133] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1129.968771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.968771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.968771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.968958] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.969098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.969165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.969375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.969438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.969490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.969592] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.970513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.970686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.970859] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.971943] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.972027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.973304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.973304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.973304] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.311077] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 1130.311410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.474262] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.474410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.474609] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.977189] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.480079] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.480079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.480186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.480371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.480496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.480598] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1131.513029] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.513152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.513152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.513388] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.514407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.525999] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1131.632767] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1131.632936] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1131.633076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.475984] env[65678]: INFO networking_nsxv3.common.synchronization [req-9e80da1d-3ee8-43f1-8165-43568b2ea2bb req-55aff185-cca9-4ad5-840c-c114b3375595 tempest-AttachVolumeTestJSON-242852111 tempest-AttachVolumeTestJSON-242852111-project-member] Enqueued Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_members [ 1132.479057] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGHEST for action security_group_members [ 1132.479057] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cad1a85-e250-44ba-929f-39b2137bd736 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.479057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.479057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.479057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.479057] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.479057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.479057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.479057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.479057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.479057] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cad1a85-e250-44ba-929f-39b2137bd736',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.983975] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.983975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.983975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.983975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.008495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.008862] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.008984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.009123] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.009278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.009391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.009450] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cad1a85-e250-44ba-929f-39b2137bd736 is going to be updated. [ 1133.049453] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.049453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.049453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.049453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.049453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.062097] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cad1a85-e250-44ba-929f-39b2137bd736 in Status: IN_PROGRESS for 2s [ 1133.538829] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1133.539234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.539333] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.539617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.539760] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.539876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.539942] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.540112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.540194] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.540297] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.045024] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.546800] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.662728] env[65678]: INFO networking_nsxv3.common.synchronization [req-73717f2c-df59-46d8-ae81-e304eba92678 req-0fa1f8f1-8ea7-42e8-ad9a-6b96b3ca2b59 tempest-ServersAdminTestJSON-1252313613 tempest-ServersAdminTestJSON-1252313613-project-member] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1134.662728] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1134.662963] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.662963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.663101] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.663649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.663649] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.663649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.663649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.664062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.664062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.664062] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.049569] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.049715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.049756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.050019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.050090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.050199] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1135.074435] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cad1a85-e250-44ba-929f-39b2137bd736 in Status: SUCCESS [ 1135.074435] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cad1a85-e250-44ba-929f-39b2137bd736 deletion is rescheduled due to dependency. [ 1135.074435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cad1a85-e250-44ba-929f-39b2137bd736" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.093023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.093023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.093023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.093023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.093023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.105610] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1135.166822] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.669413] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.175226] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.175226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.175226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.175226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.175226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.175226] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1136.206765] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.207013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.207135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.207460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.207676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.218712] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1137.115459] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1137.115914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.115914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.116142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.116340] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.116490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.116546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.116745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.116839] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.116959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.117176] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.117265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.117338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.117477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.117648] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.117767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.117850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.118035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.118136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.118233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.118338] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.620551] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ca02848-c142-45aa-adca-5a1d75fe5bb6: rpc.has_security_group_logging(os_id): False [ 1137.642028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.642028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.642028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.642028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.642028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.642282] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.642282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.642356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.642504] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.642579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.642762] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.642855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.642916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.643068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.643144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.643342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.643435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.643496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.643635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.643709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.643793] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1137.723391] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.723586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.723624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.723807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.723959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.740136] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1138.231280] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 4s [ 1139.663847] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1139.664119] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1139.786184] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1139.786184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.786184] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.786365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.786518] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.028710] env[65678]: INFO networking_nsxv3.common.synchronization [req-e45dbc65-16de-42ed-b527-49d2c6f623f4 req-f3349762-9fcc-4886-aa63-55abba50af28 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 1140.029408] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 1140.029757] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.029878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.029960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.030162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.030315] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.030417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.030881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.030881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.030881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.030881] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.245353] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1140.245650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.280714] env[65678]: INFO networking_nsxv3.common.synchronization [req-442ed67e-9869-4b73-a591-4ff5d12b1d2a req-3cf75822-5f7a-4c23-816d-6185f2557f52 tempest-MultipleCreateTestJSON-1045728445 tempest-MultipleCreateTestJSON-1045728445-project-member] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1140.281430] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1140.281748] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.281876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.281936] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.282165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.282320] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.282418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.282486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.282625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.282709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.282831] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.290240] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.290240] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.438903] env[65678]: INFO networking_nsxv3.common.synchronization [req-f6e3bae9-3999-480f-9aea-14716060bd6d req-5d8d1c95-9eeb-4b42-97a5-3dfff0ab8265 tempest-MultipleCreateTestJSON-1045728445 tempest-MultipleCreateTestJSON-1045728445-project-member] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1140.438903] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGHEST for action security_group_members [ 1140.438903] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.438903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.532589] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.786893] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.035632] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.290375] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.538977] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.539209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.539268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.539523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.539629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.539740] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b is going to be updated. [ 1141.569222] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.569403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.569438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.569686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.569842] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.583033] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: IN_PROGRESS for 2s [ 1141.787128] env[65678]: INFO networking_nsxv3.common.synchronization [req-811f8396-a6c9-4eab-b9ff-8e45d4c465fa req-72f8cd27-0a45-4d35-aa41-138492df2c62 tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1141.787771] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1141.788515] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.788645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.788718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.788928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.789102] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.789203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.789283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.789463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.789599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.789701] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.791726] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.791869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.791944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.792315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.792315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.792403] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1141.825807] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.825987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.826036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.826248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.826390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.835220] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1142.160284] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.160576] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.160756] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.161062] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.161344] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.161535] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.161657] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.162073] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.162073] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.162239] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.162350] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.162456] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.162562] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.162668] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.162770] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.162906] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.184876] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.184876] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1142.185066] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.185159] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.185588] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.185808] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.185928] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.186287] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.186417] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.292560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.294131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.294131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.294131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.294131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.294131] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.294131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.294131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.294482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.294482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.294598] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1142.326995] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.327140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.327218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.327428] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.327592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.338070] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1142.550027] env[65678]: INFO networking_nsxv3.common.synchronization [None req-3d18a83b-000d-45e9-96d3-fa1737d5db0a tempest-AttachVolumeTestJSON-242852111 tempest-AttachVolumeTestJSON-242852111-project-member] Enqueued Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_rules [ 1142.550399] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_rules [ 1142.550878] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57fdce9f-904c-425a-b6d4-0a58e3578508 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.550878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.550878] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.551162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.551246] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.641314] env[65678]: INFO networking_nsxv3.common.synchronization [None req-3cccce84-e5fe-4348-9ccb-f238cc5c149c tempest-AttachVolumeTestJSON-242852111 tempest-AttachVolumeTestJSON-242852111-project-member] Enqueued Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_rules [ 1142.641439] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_rules [ 1142.641836] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57fdce9f-904c-425a-b6d4-0a58e3578508 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.641925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.688698] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.689049] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.689238] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.689531] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.689685] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.689842] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0 not found, creating... [ 1142.690123] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.690285] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.690416] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.690746] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.690899] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.691250] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.691486] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.691622] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.691847] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.691987] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.692212] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0 is going to be created. [ 1142.712563] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.712801] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.712894] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.713341] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.713571] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.713797] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.072269] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.072619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.072619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.072681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.072860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.072860] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 already deleted. [ 1143.072994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.073109] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.073264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.073345] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.405080] env[65678]: INFO networking_nsxv3.common.synchronization [req-811f8396-a6c9-4eab-b9ff-8e45d4c465fa req-9914d71f-ad0a-4b85-95d5-301295e4693b service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1143.405235] env[65678]: INFO networking_nsxv3.common.synchronization [req-811f8396-a6c9-4eab-b9ff-8e45d4c465fa req-9914d71f-ad0a-4b85-95d5-301295e4693b service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1143.405372] env[65678]: INFO networking_nsxv3.common.synchronization [req-811f8396-a6c9-4eab-b9ff-8e45d4c465fa req-9914d71f-ad0a-4b85-95d5-301295e4693b service nova] Enqueued Resource ID: dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0 with Priority: HIGHEST for action port [ 1143.405920] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1143.405993] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1143.406220] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0 with Priority: HIGHEST for action port [ 1143.408567] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.408703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.408795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.409017] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.409110] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.410219] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.410592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.410592] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.410592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.410759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.410796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.410869] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.593780] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: SUCCESS [ 1143.594025] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.595220] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.595373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.595445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.595708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.595857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.595951] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 already deleted. [ 1143.596071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.846510] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1143.846736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.846898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.847145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.847371] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.847483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.847554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.847719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.847791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.847886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.848024] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.849625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.849817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.849984] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.850113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.850181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.850352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.850435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.850524] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.914409] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.914708] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.914917] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0 with status ACTIVE [ 1143.915106] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.915220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.915311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.915491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.915578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.915756] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.915853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.915915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.916090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.916165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.916341] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.916443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.916583] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.916721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.916721] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.916840] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0 is going to be updated. [ 1143.940980] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.941191] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.941239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.941478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.941618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.941864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfcd1bc6-bbbe-4db1-b51f-b81d349a3cd0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.232231] env[65678]: INFO networking_nsxv3.common.synchronization [req-cdd79f24-4ff0-415c-8d11-f53d92705c43 req-e38222cb-dfbc-40f4-b6cf-2c67b7cfe578 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1144.232706] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1144.234043] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.234043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.234901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.235379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.235379] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.235524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.235524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.235736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.235792] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.235887] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.349156] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1144.349343] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1144.349439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.349840] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.349934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.350042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.350315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.350513] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.350680] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.350782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.350977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.351108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.351237] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.352344] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.352438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.352548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.352752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.352923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.353118] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.353261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.353367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.353588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.353714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.353850] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1144.387564] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.387809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.387902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.388222] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.388443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.400549] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1144.652812] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.653149] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.653149] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.653381] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.654185] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.654388] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.654530] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.654743] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.654883] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.655104] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.655223] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.655331] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.655413] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.655546] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.655631] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.655755] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.678316] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.678490] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1144.678626] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.678782] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.679193] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-b34de57d-c634-436a-93a9-d616cca632fe taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.679425] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-b34de57d-c634-436a-93a9-d616cca632fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.679564] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-b34de57d-c634-436a-93a9-d616cca632fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.679974] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-b34de57d-c634-436a-93a9-d616cca632fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.680378] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b34de57d-c634-436a-93a9-d616cca632fe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.739251] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.856119] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.183236] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.183514] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.183581] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.183882] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.184051] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.184212] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port b34de57d-c634-436a-93a9-d616cca632fe not found, creating... [ 1145.184472] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.184683] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.184770] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.185011] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.185156] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.185519] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.185618] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.186093] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.186093] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.186093] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.186301] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: b34de57d-c634-436a-93a9-d616cca632fe is going to be created. [ 1145.207685] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.208057] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.208057] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.208429] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.208727] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.209711] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-b34de57d-c634-436a-93a9-d616cca632fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.243913] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.358846] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.748148] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.748368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.748482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.748828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.748974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.749238] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1145.780338] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.780338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.780338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.780338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.780338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.793453] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1145.862163] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.862320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.862393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.862615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.862716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.862841] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1145.896871] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.896871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.896871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.896871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.896871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.909090] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1145.943392] env[65678]: INFO networking_nsxv3.common.synchronization [req-cdd79f24-4ff0-415c-8d11-f53d92705c43 req-721651f9-63ae-430d-8390-e0e6b4c9b459 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1145.943580] env[65678]: INFO networking_nsxv3.common.synchronization [req-cdd79f24-4ff0-415c-8d11-f53d92705c43 req-721651f9-63ae-430d-8390-e0e6b4c9b459 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1145.943716] env[65678]: INFO networking_nsxv3.common.synchronization [req-cdd79f24-4ff0-415c-8d11-f53d92705c43 req-721651f9-63ae-430d-8390-e0e6b4c9b459 service nova] Enqueued Resource ID: b34de57d-c634-436a-93a9-d616cca632fe with Priority: HIGHEST for action port [ 1145.945039] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1145.945039] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1145.945039] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b34de57d-c634-436a-93a9-d616cca632fe with Priority: HIGHEST for action port [ 1145.945039] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.945039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.945039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.945754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.945754] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.947074] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.947181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.947551] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b34de57d-c634-436a-93a9-d616cca632fe taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.947683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b34de57d-c634-436a-93a9-d616cca632fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.947765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b34de57d-c634-436a-93a9-d616cca632fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.948270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b34de57d-c634-436a-93a9-d616cca632fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.948270] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b34de57d-c634-436a-93a9-d616cca632fe',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.411119] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1146.411473] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 deletion is rescheduled due to dependency. [ 1146.411473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.411591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.411778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.411973] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.412106] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.412174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.412329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.412420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.412496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.412868] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ca02848-c142-45aa-adca-5a1d75fe5bb6 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.412868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.412868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.412975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.413182] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.413244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.413305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.413401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.413467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.413549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.413640] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ca02848-c142-45aa-adca-5a1d75fe5bb6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.447832] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.447983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.450353] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b34de57d-c634-436a-93a9-d616cca632fe with status ACTIVE [ 1146.450548] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.450674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.450988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.451245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.451353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.451537] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.451640] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.451703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.451858] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.451934] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.452129] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.452256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.452341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.452490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.452565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.452651] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b34de57d-c634-436a-93a9-d616cca632fe is going to be updated. [ 1146.474971] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.475138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.475213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.475428] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.475622] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.475845] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b34de57d-c634-436a-93a9-d616cca632fe" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.915676] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ca02848-c142-45aa-adca-5a1d75fe5bb6: rpc.has_security_group_logging(os_id): False [ 1146.934271] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.934271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.934271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.934271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.934271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.934271] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.935410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.935410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.935410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.935410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.935410] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.935410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.935410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.935410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.935410] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.935701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.935701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.935701] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.935796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.935796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.935933] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 is going to be updated. [ 1147.046065] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.046371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.046371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.046673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.046860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.069201] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: IN_PROGRESS for 2s [ 1147.805251] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1147.805547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.805633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.805850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.806050] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.806174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.806236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.806394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.806475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.806572] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.920181] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1147.920405] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.920585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.920948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.921056] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.921162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.921237] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.921409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.921483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.921571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.921711] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.935748] env[65678]: INFO networking_nsxv3.common.synchronization [req-f8dfdc78-3c7a-435b-bcf7-294dde424151 req-7e081603-892e-46c2-98fa-c362e7c6fd7a tempest-ServersAdminTestJSON-1252313613 tempest-ServersAdminTestJSON-1252313613-project-member] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1147.936302] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGHEST for action security_group_members [ 1147.936650] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f236cc9-1bc2-44e5-b39b-04c5909837a7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.936767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.936829] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.939790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.939790] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.939790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.939790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.945157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.945157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.945157] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f236cc9-1bc2-44e5-b39b-04c5909837a7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.309486] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.423818] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.424013] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.424098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.424330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.424608] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.424791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.424867] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.425066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.425163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.425282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.425462] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.425597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.425681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.425838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.425984] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.426092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.426167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.426364] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.426438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.426522] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.426611] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.447305] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.447461] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.447532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.447883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.447984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.448205] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.448308] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.448371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.448526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.448602] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.448687] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 is going to be updated. [ 1148.479323] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.479526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.479625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.479888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.480091] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.489353] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: IN_PROGRESS for 2s [ 1148.811778] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.928930] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50c43a13-ebd7-47b2-924e-039a5d7a4354: rpc.has_security_group_logging(os_id): False [ 1148.951363] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.951363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.951363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.951586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.951586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.951733] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.951822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.951873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.952070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.952151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.952352] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.952447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.952508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.952672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.952748] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.952980] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.953095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.953232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.953299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.953376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.953487] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1149.017792] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.017949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.018033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.018256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.018401] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.035053] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1149.087511] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 in Status: SUCCESS [ 1149.087740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ca02848-c142-45aa-adca-5a1d75fe5bb6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.314857] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.315034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.315116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.315342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.315433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.315534] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1149.350433] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.350433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.350433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.350765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.350802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.360096] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1150.500133] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 in Status: SUCCESS [ 1150.500467] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 deletion is rescheduled due to dependency. [ 1150.500467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f236cc9-1bc2-44e5-b39b-04c5909837a7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.771497] env[65678]: INFO networking_nsxv3.common.synchronization [req-9d17cb1d-1209-4461-a4c9-03627d746312 req-981b8e27-2ad8-4508-b733-18c4fecbd934 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 1150.772085] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGHEST for action security_group_members [ 1150.772512] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.772781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.772781] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.773070] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.773293] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.773446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.773555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.773778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.773923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.774099] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.189681] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1151.189681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.277135] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.277135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.277135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.277416] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.312433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.312711] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.312881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.312993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.313143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.313227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.313332] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b is going to be updated. [ 1151.363591] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.363727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.363823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.364057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.364209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.374015] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: IN_PROGRESS for 2s [ 1151.374967] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1151.375213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.375398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.375628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.375841] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.375963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.376034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.376304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.376304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.376424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.376465] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.880139] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.880139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.880139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.880139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.880139] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.880139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.880139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.880139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.880798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.880798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.880798] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.880798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.880798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.880798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.881023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.881127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.881182] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.881325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.881398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.881478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.881566] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.383623] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79cab93f-aae5-467c-88f3-35382c30a4ef: rpc.has_security_group_logging(os_id): False [ 1152.401912] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.402081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.402238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.402436] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.402552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.402894] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.403067] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.403171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.403435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.403569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.403803] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.403909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.403974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.404144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.404223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.404417] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.404511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.404574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.404778] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.404891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.404970] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1152.477160] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.477340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.477383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.477597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.477743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.494054] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1153.385272] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9687b7d1-a464-4878-ae3a-b131f314c98b in Status: SUCCESS [ 1153.385585] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b deletion is rescheduled due to dependency. [ 1153.385585] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.512611] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1154.513146] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.909429] env[65678]: INFO networking_nsxv3.common.synchronization [req-99b017e2-1707-4d81-8c08-7c9bad5add15 req-43e87727-361d-4dcb-898c-85c4917f8586 tempest-AttachVolumeTestJSON-242852111 tempest-AttachVolumeTestJSON-242852111-project-member] Enqueued Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_members [ 1154.909429] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_members [ 1154.909507] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-57fdce9f-904c-425a-b6d4-0a58e3578508 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.909610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.909804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.909980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.910235] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.910235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.910545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.910545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.910625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.910669] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.332561] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-971 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.332766] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-971" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.332887] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-971" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.333197] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-971" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.333457] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.333614] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.333729] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.333942] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.334091] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.334296] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.334403] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.334507] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.334610] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.334752] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.334870] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.335013] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.354429] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.354565] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1155.354717] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.354918] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-971" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.355246] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.355419] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.355533] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.355854] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.355993] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.412977] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.413147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.413220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.413425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.413512] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.413706] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.413801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.413864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.414081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.414144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.414178] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 already deleted. [ 1155.414251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.858447] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.858790] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.858790] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.859034] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.859188] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.859339] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f not found, creating... [ 1155.859595] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.859763] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.859876] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.860117] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.860252] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.860537] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.860691] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.860805] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.861055] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.861192] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.861328] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f is going to be created. [ 1155.880764] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.880965] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.881101] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.881439] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.882047] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.882326] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.458703] env[65678]: INFO networking_nsxv3.common.synchronization [None req-9514c781-7991-4c3a-ba18-0cf34cb3b5e2 None None] Enqueued Resource ID: 9c6c02e1-64eb-4c6c-b56c-2b75f95c478d with Priority: HIGHEST for action port [ 1156.459680] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c6c02e1-64eb-4c6c-b56c-2b75f95c478d with Priority: HIGHEST for action port [ 1156.462192] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c6c02e1-64eb-4c6c-b56c-2b75f95c478d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.462192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c6c02e1-64eb-4c6c-b56c-2b75f95c478d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.462192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c6c02e1-64eb-4c6c-b56c-2b75f95c478d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.462192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c6c02e1-64eb-4c6c-b56c-2b75f95c478d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.462192] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c6c02e1-64eb-4c6c-b56c-2b75f95c478d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.604544] env[65678]: INFO networking_nsxv3.common.synchronization [req-99b017e2-1707-4d81-8c08-7c9bad5add15 req-eff3435e-fcf9-4ec7-8c0f-758beab18e31 service nova] Enqueued Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_rules [ 1156.604732] env[65678]: INFO networking_nsxv3.common.synchronization [req-99b017e2-1707-4d81-8c08-7c9bad5add15 req-eff3435e-fcf9-4ec7-8c0f-758beab18e31 service nova] Enqueued Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_members [ 1156.604871] env[65678]: INFO networking_nsxv3.common.synchronization [req-99b017e2-1707-4d81-8c08-7c9bad5add15 req-eff3435e-fcf9-4ec7-8c0f-758beab18e31 service nova] Enqueued Resource ID: 76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f with Priority: HIGHEST for action port [ 1156.606067] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_rules [ 1156.606157] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_members [ 1156.606255] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f with Priority: HIGHEST for action port [ 1156.607136] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57fdce9f-904c-425a-b6d4-0a58e3578508 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.607270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.607335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.607545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.607804] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.610121] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-57fdce9f-904c-425a-b6d4-0a58e3578508 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.610121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.610121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.610121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.610318] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.610363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.610548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.610966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.612257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.612386] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.613305] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.613420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.613514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.613796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.613924] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.963080] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c6c02e1-64eb-4c6c-b56c-2b75f95c478d [ 1156.965314] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.965314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.965314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.965314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.965314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.965314] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c6c02e1-64eb-4c6c-b56c-2b75f95c478d already deleted. [ 1156.965314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c6c02e1-64eb-4c6c-b56c-2b75f95c478d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.117411] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-57fdce9f-904c-425a-b6d4-0a58e3578508 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.117554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.117736] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f with status ACTIVE [ 1157.120910] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.120910] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.120910] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.120910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.120910] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f is going to be updated. [ 1157.123587] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.153637] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.153637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.153769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.154152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.154152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.154291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76dcaa6f-cd27-43d9-a0f0-76ebdd075e9f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.630635] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.881224] env[65678]: INFO networking_nsxv3.common.synchronization [None req-a4743691-03a0-4cf3-a53e-7254d0fec453 tempest-ServerActionsTestOtherB-194906544 tempest-ServerActionsTestOtherB-194906544-project-member] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1157.881224] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1157.883383] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.883383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.883383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.883828] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.883828] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.034378] env[65678]: INFO networking_nsxv3.common.synchronization [None req-edec0112-04f2-4644-8b93-6ebc454f8310 tempest-ServerActionsTestOtherB-194906544 tempest-ServerActionsTestOtherB-194906544-project-member] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1158.035094] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1158.035413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.035564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.136169] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.136332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.136445] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.136835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.137012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.137122] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 is going to be created. [ 1158.166940] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.167163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.167211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.167587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.167690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.180710] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 in Status: UNINITIALIZED for 2s [ 1158.409527] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.409757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.409919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.410433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.410433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.410433] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 already deleted. [ 1158.410633] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.410663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.410836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.410925] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.426621] env[65678]: INFO networking_nsxv3.common.synchronization [None req-0c573f21-5505-4a2a-9e1c-f539310ca578 None None] Enqueued Resource ID: 7f08b376-9e70-46a9-bdf3-90f53c8c40f5 with Priority: HIGHEST for action port [ 1158.429038] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f08b376-9e70-46a9-bdf3-90f53c8c40f5 with Priority: HIGHEST for action port [ 1158.429305] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f08b376-9e70-46a9-bdf3-90f53c8c40f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.429435] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f08b376-9e70-46a9-bdf3-90f53c8c40f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.429503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f08b376-9e70-46a9-bdf3-90f53c8c40f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.429814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f08b376-9e70-46a9-bdf3-90f53c8c40f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.429951] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f08b376-9e70-46a9-bdf3-90f53c8c40f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.936212] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.936212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.936212] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.936494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.936494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.936565] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 already deleted. [ 1158.936645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.936878] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f08b376-9e70-46a9-bdf3-90f53c8c40f5 [ 1158.937090] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.937195] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.937258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.937520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.937520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.937598] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f08b376-9e70-46a9-bdf3-90f53c8c40f5 already deleted. [ 1158.937654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f08b376-9e70-46a9-bdf3-90f53c8c40f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.958858] env[65678]: INFO networking_nsxv3.common.synchronization [req-82f2b5cf-c4e7-438b-ba68-83db99390554 req-63bb6e5e-2fd6-42c2-a56a-41a7de4610d1 tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1158.959868] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1158.959868] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.959868] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.960089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.965352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.965576] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.965710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.965755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.965949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.966052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.966152] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.470175] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.470175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.470175] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.474250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.474250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.474250] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.474250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.474250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.474250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.474250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.474250] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1159.512164] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.512164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.512164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.512164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.512164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.521770] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1160.191377] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 in Status: SUCCESS [ 1160.192506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.192506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.192647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.193302] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.193302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.193302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.193625] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.193844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.194037] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.194130] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.697234] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.165160] env[65678]: INFO networking_nsxv3.common.synchronization [None req-4e4ee120-8083-4e4b-a376-199454765085 tempest-AttachInterfacesTestJSON-254233845 tempest-AttachInterfacesTestJSON-254233845-project-member] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 1161.165841] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGHEST for action security_group_members [ 1161.166234] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.166372] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.166456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.166661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.166846] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.167071] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.167139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.167289] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.167381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.167515] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.200716] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57fdce9f-904c-425a-b6d4-0a58e3578508: rpc.has_security_group_logging(os_id): False [ 1161.218438] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.218438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.218438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.218438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.218438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.218875] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.218875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.218875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.218979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.219024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.219124] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 is going to be created. [ 1161.331359] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.331359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.331359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.331359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.331359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.349817] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 in Status: IN_PROGRESS for 2s [ 1161.533458] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1161.533458] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1161.533458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.670385] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.670562] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.670636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.670876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.670991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.671191] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.671264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.671353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.671516] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.671594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.671682] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be updated. [ 1161.700566] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.700902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.700902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.700997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.701137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.711242] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: IN_PROGRESS for 2s [ 1162.264767] env[65678]: INFO networking_nsxv3.common.synchronization [req-cf4d77eb-62af-448b-a054-d49ef939a617 req-7ec2d17f-550d-4012-a250-7be94d79ffd4 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1162.264767] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1162.264767] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.264767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.265201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.265201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.265434] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.265536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.265536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.265709] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.265857] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.265857] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.768310] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.271169] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.365084] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 in Status: SUCCESS [ 1163.365084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.723154] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 in Status: SUCCESS [ 1163.723761] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 deletion is rescheduled due to dependency. [ 1163.723761] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.774332] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.774704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.774704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.775079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.775226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.775343] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1163.810344] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.810542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.810542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.810769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.810916] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.821689] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1165.681544] env[65678]: INFO networking_nsxv3.common.synchronization [None req-183407b0-a824-4775-aed2-21f099dd4e6e None None] Enqueued Resource ID: 09ef1065-438c-4d5c-92c2-849c33d7d9ca with Priority: HIGHEST for action port [ 1165.682184] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ef1065-438c-4d5c-92c2-849c33d7d9ca with Priority: HIGHEST for action port [ 1165.682513] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-09ef1065-438c-4d5c-92c2-849c33d7d9ca taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.682665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09ef1065-438c-4d5c-92c2-849c33d7d9ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.682737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09ef1065-438c-4d5c-92c2-849c33d7d9ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.683278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09ef1065-438c-4d5c-92c2-849c33d7d9ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.683278] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09ef1065-438c-4d5c-92c2-849c33d7d9ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.833874] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1165.834137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.186331] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09ef1065-438c-4d5c-92c2-849c33d7d9ca [ 1166.186331] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.186331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.186331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.186331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.186331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.186331] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09ef1065-438c-4d5c-92c2-849c33d7d9ca already deleted. [ 1166.186331] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09ef1065-438c-4d5c-92c2-849c33d7d9ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.397719] env[65678]: INFO networking_nsxv3.common.synchronization [None req-d2534154-79ed-483c-969b-82983ccda321 tempest-ServerActionsV293TestJSON-1224759286 tempest-ServerActionsV293TestJSON-1224759286-project-member] Enqueued Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_rules [ 1166.397719] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_rules [ 1166.397719] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.397719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.397719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.397719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.397719] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.499960] env[65678]: INFO networking_nsxv3.common.synchronization [None req-e8846adc-b63b-4489-8421-84b8662c959b tempest-ServerActionsV293TestJSON-1224759286 tempest-ServerActionsV293TestJSON-1224759286-project-member] Enqueued Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_rules [ 1166.499960] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_rules [ 1166.500347] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.500347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.923664] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.923944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.923944] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.924183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.925279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.925279] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc already deleted. [ 1166.925279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.925279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.925279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.925279] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.445550] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.445624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.445656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.446624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.446624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.446624] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc already deleted. [ 1167.446624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.009249] env[65678]: INFO networking_nsxv3.common.synchronization [None req-f11291c4-8464-440b-bf17-e91e8f3f4722 None None] Enqueued Resource ID: 4ad93305-a894-4405-9302-1d13806e6de2 with Priority: HIGHEST for action port [ 1168.010120] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ad93305-a894-4405-9302-1d13806e6de2 with Priority: HIGHEST for action port [ 1168.011728] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ad93305-a894-4405-9302-1d13806e6de2 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.011859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ad93305-a894-4405-9302-1d13806e6de2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.011928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ad93305-a894-4405-9302-1d13806e6de2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.012236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ad93305-a894-4405-9302-1d13806e6de2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.012320] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad93305-a894-4405-9302-1d13806e6de2',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.515116] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ad93305-a894-4405-9302-1d13806e6de2 [ 1168.515407] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.515571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.515666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.516023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.516023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.516105] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ad93305-a894-4405-9302-1d13806e6de2 already deleted. [ 1168.516192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ad93305-a894-4405-9302-1d13806e6de2" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.999707] env[65678]: INFO networking_nsxv3.common.synchronization [req-7389b697-a05a-4978-a624-e410a2872e00 req-d5bb3b6c-53f1-4b8d-9ac9-0cec01b1188b tempest-ServerActionsTestOtherB-194906544 tempest-ServerActionsTestOtherB-194906544-project-member] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1169.000267] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1169.000660] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.000737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.000772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.001189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.001227] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.001305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.001369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.001524] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.001611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.001703] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.317358] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-773 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.317752] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.317752] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.317985] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.320038] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.320038] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.320038] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.320038] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.320038] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.320038] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.320038] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.320038] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.320038] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.320038] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.320038] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.320038] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.344518] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.344713] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1169.344837] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.345000] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.345796] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.345796] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.345796] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.346015] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.346099] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7074dc50-8bfb-47b9-86f0-dac8e8f806a6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.504206] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.504206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.504322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.504485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.504577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.504769] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.504866] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.504928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.505131] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.505209] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.505298] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 already deleted. [ 1169.505402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.849024] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.849265] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.849394] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.849717] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.849872] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.850035] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 7074dc50-8bfb-47b9-86f0-dac8e8f806a6 not found, creating... [ 1169.850309] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.850468] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.850583] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.850806] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.850942] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.851241] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.851591] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.851591] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.852042] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.852042] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.852042] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 7074dc50-8bfb-47b9-86f0-dac8e8f806a6 is going to be created. [ 1169.875692] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.875944] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.876081] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.876466] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.876813] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.877182] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.635893] env[65678]: INFO networking_nsxv3.common.synchronization [req-7389b697-a05a-4978-a624-e410a2872e00 req-ecd5c026-2fd1-4e0c-9479-08d631868267 service nova] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1170.635893] env[65678]: INFO networking_nsxv3.common.synchronization [req-7389b697-a05a-4978-a624-e410a2872e00 req-ecd5c026-2fd1-4e0c-9479-08d631868267 service nova] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1170.635893] env[65678]: INFO networking_nsxv3.common.synchronization [req-7389b697-a05a-4978-a624-e410a2872e00 req-ecd5c026-2fd1-4e0c-9479-08d631868267 service nova] Enqueued Resource ID: 7074dc50-8bfb-47b9-86f0-dac8e8f806a6 with Priority: HIGHEST for action port [ 1170.636333] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1170.636486] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1170.636643] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7074dc50-8bfb-47b9-86f0-dac8e8f806a6 with Priority: HIGHEST for action port [ 1170.636970] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.637172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.637250] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.637919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.638096] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.639146] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.639292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.639370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.639594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.639775] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.639880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.639965] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.645403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.645403] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.645403] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.647674] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.647674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.647674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.647674] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.647674] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7074dc50-8bfb-47b9-86f0-dac8e8f806a6',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.149570] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.150079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.150352] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.151345] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7074dc50-8bfb-47b9-86f0-dac8e8f806a6 with status ACTIVE [ 1171.152012] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.152012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.152012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.152012] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.152404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.152404] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.152404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.152766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.152900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.154044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.154044] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.154044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.154044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.154044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.154044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.154044] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7074dc50-8bfb-47b9-86f0-dac8e8f806a6 is going to be updated. [ 1171.178992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.179238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.179342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.179661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.179812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.179982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7074dc50-8bfb-47b9-86f0-dac8e8f806a6" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.258173] env[65678]: INFO networking_nsxv3.common.synchronization [req-6e21a777-420d-4ca3-894b-aa09c92d3868 req-d0344ffe-3626-49e4-be64-384873b91aad tempest-ListImageFiltersTestJSON-544928916 tempest-ListImageFiltersTestJSON-544928916-project-member] Enqueued Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1171.258315] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1171.258827] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.259035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.259161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.259495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.259740] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.259902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.260018] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.260306] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.260456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.260619] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.656252] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.766520] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.158896] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.159048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.159122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.159340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.159431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.159979] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be created. [ 1172.184914] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.185164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.185164] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.185366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.185525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.197430] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: UNINITIALIZED for 2s [ 1172.268989] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.771401] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.771768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.771768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.772152] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.772290] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.772494] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 is going to be updated. [ 1172.805498] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.805754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.805884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.806214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.806439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.818608] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: IN_PROGRESS for 2s [ 1173.203044] env[65678]: INFO networking_nsxv3.common.synchronization [req-f8d3017b-c074-4d93-9ba6-a6c61d3508ba req-28e7dbfa-02c9-4fa9-8300-cab1fb927068 tempest-AttachVolumeNegativeTest-1277747849 tempest-AttachVolumeNegativeTest-1277747849-project-member] Enqueued Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_members [ 1173.204813] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGHEST for action security_group_members [ 1173.205287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-530d93d3-1148-4ef5-af5b-5267dece0166 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.205505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.206807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.207543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.207904] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.208089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.208340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.209741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.209741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.209741] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.711727] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.711906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.711970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.712181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.712282] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.712485] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.712598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.712668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.714232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.714232] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.714232] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530d93d3-1148-4ef5-af5b-5267dece0166 is going to be updated. [ 1173.746022] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.746022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.746022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.746022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.746022] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.756034] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530d93d3-1148-4ef5-af5b-5267dece0166 in Status: IN_PROGRESS for 2s [ 1174.207328] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: UNINITIALIZED for 4s [ 1174.830283] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: SUCCESS [ 1174.830502] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.637562] env[65678]: INFO networking_nsxv3.common.synchronization [req-86cdbc95-8ce6-431e-b2c1-240c3bd42b31 req-5b52c541-4acb-4576-907f-3610244650ce tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1175.638132] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1175.638467] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.638928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.638928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.638928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.639067] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.639113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.639225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.639324] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.639407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.639499] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.765860] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530d93d3-1148-4ef5-af5b-5267dece0166 in Status: SUCCESS [ 1175.766048] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530d93d3-1148-4ef5-af5b-5267dece0166 deletion is rescheduled due to dependency. [ 1175.766180] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.955345] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.955704] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.955704] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.955949] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.956217] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.956367] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.956483] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.956689] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.956831] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.957040] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.957154] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.957273] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.957393] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.957505] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.957606] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.957734] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.977200] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.977399] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.977572] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.977788] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.978159] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-8b6f3429-df37-4480-a933-1ed2e4355fa9 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.978455] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-8b6f3429-df37-4480-a933-1ed2e4355fa9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.978606] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-8b6f3429-df37-4480-a933-1ed2e4355fa9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.978981] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-8b6f3429-df37-4480-a933-1ed2e4355fa9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.979215] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b6f3429-df37-4480-a933-1ed2e4355fa9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.144624] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.144624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.144624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.144624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.144624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.144624] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.144624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.144624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.144624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.144624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.144624] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1176.171260] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.171260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.171260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.171542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.171705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.182017] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1176.217557] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1176.217762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.217929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.218183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.218382] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.218486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.218563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.218716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.218819] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.218937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.218998] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.481534] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.481837] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.481932] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.482242] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.482551] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.482551] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 8b6f3429-df37-4480-a933-1ed2e4355fa9 not found, creating... [ 1176.482894] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.483047] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.483207] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.483450] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.483591] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.483949] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.484143] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.484275] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.484544] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.484712] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.484853] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 8b6f3429-df37-4480-a933-1ed2e4355fa9 is going to be created. [ 1176.504582] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.504809] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.504919] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.505249] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.505492] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.505748] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-8b6f3429-df37-4480-a933-1ed2e4355fa9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.720729] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.223442] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8edd9-578b-4843-bee9-3ea3ba7e5469: rpc.has_security_group_logging(os_id): False [ 1177.248023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.248023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.248023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.248023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.248023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.248023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.248023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.248023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.248023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.248023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.248023] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be created. [ 1177.274104] env[65678]: INFO networking_nsxv3.common.synchronization [req-86cdbc95-8ce6-431e-b2c1-240c3bd42b31 req-903d0f2e-31d4-4d45-a63e-8070ca108a97 service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1177.274325] env[65678]: INFO networking_nsxv3.common.synchronization [req-86cdbc95-8ce6-431e-b2c1-240c3bd42b31 req-903d0f2e-31d4-4d45-a63e-8070ca108a97 service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1177.274325] env[65678]: INFO networking_nsxv3.common.synchronization [req-86cdbc95-8ce6-431e-b2c1-240c3bd42b31 req-903d0f2e-31d4-4d45-a63e-8070ca108a97 service nova] Enqueued Resource ID: 8b6f3429-df37-4480-a933-1ed2e4355fa9 with Priority: HIGHEST for action port [ 1177.274931] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1177.275090] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1177.275234] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b6f3429-df37-4480-a933-1ed2e4355fa9 with Priority: HIGHEST for action port [ 1177.276887] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.276887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.276887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.276887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.276887] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.279130] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.279130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.279130] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b6f3429-df37-4480-a933-1ed2e4355fa9 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.279130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b6f3429-df37-4480-a933-1ed2e4355fa9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.279130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b6f3429-df37-4480-a933-1ed2e4355fa9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.279130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b6f3429-df37-4480-a933-1ed2e4355fa9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.279130] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b6f3429-df37-4480-a933-1ed2e4355fa9',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.329791] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.329959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.329959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.330200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.330400] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.351071] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1177.591636] env[65678]: INFO networking_nsxv3.common.synchronization [req-2be22f67-0bc1-414b-80b6-e172876f5921 req-224b214a-e5aa-48db-8dbc-13c04c831b04 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1177.592379] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1177.592846] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.592946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.592946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.593171] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.593342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.593447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.593514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.593675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.593772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.593869] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.779821] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.780153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.780430] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b6f3429-df37-4480-a933-1ed2e4355fa9 with status ACTIVE [ 1177.780701] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.780863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.781024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.781338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.781481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.781807] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.781960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.782089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.782818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.782818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.782818] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.782972] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.783021] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.783312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.783468] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.783599] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b6f3429-df37-4480-a933-1ed2e4355fa9 is going to be updated. [ 1177.808697] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.808883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.808995] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.809314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.809887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.810150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b6f3429-df37-4480-a933-1ed2e4355fa9" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.868372] env[65678]: INFO networking_nsxv3.common.synchronization [req-c120c38a-6501-4c7d-b5fc-33a227b0e246 req-f0d67e57-abd3-4400-895f-24a05f2afbaf tempest-AttachVolumeShelveTestJSON-1282061189 tempest-AttachVolumeShelveTestJSON-1282061189-project-member] Enqueued Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_members [ 1177.869370] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGHEST for action security_group_members [ 1177.869717] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b06f75c-4a15-46fd-8850-579c633c71af taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.869849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.870607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.870607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.870607] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.870607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.870607] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.870925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.870925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.871033] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b06f75c-4a15-46fd-8850-579c633c71af',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.948155] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-188 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.948438] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.948494] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.948802] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.949122] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.949282] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.949400] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.949638] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.949817] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.950248] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.950394] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.950509] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.950641] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.950756] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.950860] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.950995] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.971860] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.972044] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1177.972241] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.972395] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-188" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.972718] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.973119] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.973119] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.973397] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.973556] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.095678] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.194072] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1178.194278] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1178.194362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.194536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.194824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.195015] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.196398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.196398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.196398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.196398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.196398] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.373552] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.373715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.373797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.374015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.374118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.374338] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.374453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.374489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.374658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.374741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.374817] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b06f75c-4a15-46fd-8850-579c633c71af is going to be updated. [ 1178.404296] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.404875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.405082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.405328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.405532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.415850] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: IN_PROGRESS for 2s [ 1178.476108] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.476401] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.476561] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.476867] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.477070] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.477340] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b not found, creating... [ 1178.477662] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.477870] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.478031] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.478542] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.478542] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.478828] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.479112] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.479284] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.479694] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.479877] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.480062] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b is going to be created. [ 1178.501370] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.501724] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.502105] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.502394] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.502624] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.502892] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.598471] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.697657] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.100802] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.101210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.101210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.101279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.101352] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.101541] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1179.139138] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.139285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.139285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.139581] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.139632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.151962] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1179.201745] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.293372] env[65678]: INFO networking_nsxv3.common.synchronization [req-2be22f67-0bc1-414b-80b6-e172876f5921 req-5406edf7-1c3c-465f-9bd7-2793d1a6bf12 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1179.294021] env[65678]: INFO networking_nsxv3.common.synchronization [req-2be22f67-0bc1-414b-80b6-e172876f5921 req-5406edf7-1c3c-465f-9bd7-2793d1a6bf12 service nova] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1179.294021] env[65678]: INFO networking_nsxv3.common.synchronization [req-2be22f67-0bc1-414b-80b6-e172876f5921 req-5406edf7-1c3c-465f-9bd7-2793d1a6bf12 service nova] Enqueued Resource ID: 5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b with Priority: HIGHEST for action port [ 1179.295972] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_rules [ 1179.295972] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1179.295972] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b with Priority: HIGHEST for action port [ 1179.295972] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.296825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.296825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.296825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.296825] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.300198] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.300198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.300198] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.300198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.300198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.300393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.300691] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.366412] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1179.366657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.705240] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.705487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.705487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.705698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.705795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.705896] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1179.738967] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.739126] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.739196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.739407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.739569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.752057] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1179.802758] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.803452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.803452] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b with status ACTIVE [ 1179.803452] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.803452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.803813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.803813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.803813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.804020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.804088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.804134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.804351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.804481] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.804696] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.804885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.804952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.805122] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.805224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.805456] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b is going to be updated. [ 1179.834216] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.834374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.834463] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.835098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.835098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.835098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cb2968d-bfb8-4d4a-9bf3-8f9a77b3741b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.431153] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b06f75c-4a15-46fd-8850-579c633c71af in Status: SUCCESS [ 1180.431450] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b06f75c-4a15-46fd-8850-579c633c71af deletion is rescheduled due to dependency. [ 1180.431557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b06f75c-4a15-46fd-8850-579c633c71af" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.162930] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1181.163168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.163340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.163599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.163843] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.164057] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.164127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.164269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.164417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.164531] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.667577] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.766888] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1181.766888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.766888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.766888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.766888] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.766888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.766888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.766888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.766888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.766888] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.766888] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.925958] env[65678]: INFO networking_nsxv3.common.synchronization [req-71035fec-ec1e-4def-8095-0f254d668588 req-f6ad03bf-301c-4929-903f-83ec53d45f50 tempest-ListImageFiltersTestJSON-544928916 tempest-ListImageFiltersTestJSON-544928916-project-member] Enqueued Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1181.925958] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGHEST for action security_group_members [ 1181.925958] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.928864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.928989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.929158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.929348] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.929457] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.929521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.929688] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.929788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.929888] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.170467] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.269553] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.269739] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.269846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.270052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.270300] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.270427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.270494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.270673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.270764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.270854] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.271017] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.271116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.271177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.271323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.271458] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.271550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.271611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.271747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.271820] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.271901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.271991] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.432348] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.432576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.432576] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.432804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.432956] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.433283] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.433419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.433488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.433673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.433754] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.433844] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 is going to be updated. [ 1182.463063] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.463213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.463285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.463707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.463707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.475547] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: IN_PROGRESS for 2s [ 1182.676287] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.676675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.676675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.676756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.676824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.676927] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1182.708087] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.708087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.708087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.708311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.709024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.718103] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1182.774762] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50c43a13-ebd7-47b2-924e-039a5d7a4354: rpc.has_security_group_logging(os_id): False [ 1182.792871] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.793042] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.793103] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.793309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.793399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.793739] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.793739] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.793912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.793912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.794055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.794174] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.794265] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.794325] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.794465] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.794537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.794723] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.794813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.794871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.795020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.795127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.795174] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1182.870593] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.870782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.870825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.871034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.871168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.891226] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1184.488805] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 in Status: SUCCESS [ 1184.489122] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 deletion is rescheduled due to dependency. [ 1184.489187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.730611] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1184.730881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.731079] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.731344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.731573] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.731724] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.731810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.731991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.732133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.732246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.732385] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.963433] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1184.963661] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.234683] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.234848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.234925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.235188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.235407] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.235483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.235552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.235722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.235822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.235904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.236075] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.236169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.236239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.236387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.236539] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.236637] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.236713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.236858] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.236991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.237062] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.237132] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.739701] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79cab93f-aae5-467c-88f3-35382c30a4ef: rpc.has_security_group_logging(os_id): False [ 1185.760216] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.760376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.760418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.760644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.760745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.760966] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.761082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.761142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.761293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.761370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.761546] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.761719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.761719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.761834] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.761905] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.762107] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.762197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.762258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.762393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.762467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.762552] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1185.821348] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.821497] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.821558] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.821776] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.822050] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.839429] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1186.926030] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1186.926436] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1187.872721] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1187.872966] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.308983] env[65678]: INFO networking_nsxv3.common.synchronization [req-be8c4359-0b3d-48e6-a39b-cbbbb7019c3d req-da0d978f-e6de-4de9-b633-b7935d7c57fb tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1191.309552] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1191.309856] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.310133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.310316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.310545] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.310712] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.310818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.310881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.311051] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.311141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.311233] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.814049] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.814271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.814359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.814664] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.814791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.815046] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.815170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.815233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.815425] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.815560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.815665] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1191.871232] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.871458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.871530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.871758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.871946] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.889838] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1192.570896] env[65678]: INFO networking_nsxv3.common.synchronization [req-3cf4956e-2115-4642-b07a-042170f5cd9d req-a53cf70a-7f05-4664-acad-0396129bdd70 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1192.571506] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1192.571817] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.571940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.572032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.572291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.572450] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.572551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.572616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.572765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.572849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.572940] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.075873] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.577710] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.615252] env[65678]: INFO networking_nsxv3.common.synchronization [req-49e313dc-6796-4f8f-929b-f65459497888 req-68de23e5-b217-4025-9946-676d0c623928 tempest-ServerActionsV293TestJSON-1224759286 tempest-ServerActionsV293TestJSON-1224759286-project-member] Enqueued Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_members [ 1193.616024] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_members [ 1193.616277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.616417] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.616485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.616777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.616940] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.617052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.617139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.617275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.617394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.617522] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.908783] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1193.908988] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1193.909116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.988796] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.989137] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-809" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.989304] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-809" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.989713] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-809" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.989999] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.990282] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.990427] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.990703] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.990979] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.991271] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.991419] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.991556] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.991761] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.991899] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.992073] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.992246] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.015450] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.015673] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1194.015790] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.015968] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-809" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.016339] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-98a76752-fbc0-461b-adfb-4b3b722d56e8 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.016519] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-98a76752-fbc0-461b-adfb-4b3b722d56e8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.016636] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-98a76752-fbc0-461b-adfb-4b3b722d56e8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.017019] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-98a76752-fbc0-461b-adfb-4b3b722d56e8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.017171] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98a76752-fbc0-461b-adfb-4b3b722d56e8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.081538] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.081752] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.081817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.082118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.082256] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.082370] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1194.119964] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.120148] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.120217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.120442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.120527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.120734] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.120851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.120949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.121130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.121208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.121297] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc already deleted. [ 1194.121373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.144349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.144617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.144713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.145045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.145323] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.162023] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1194.520919] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.521181] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.521301] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.521698] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.521971] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.522223] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 98a76752-fbc0-461b-adfb-4b3b722d56e8 not found, creating... [ 1194.522900] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.522900] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.522900] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.523354] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.523598] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.524094] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.524285] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.524509] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.524775] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.524955] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.525181] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 98a76752-fbc0-461b-adfb-4b3b722d56e8 is going to be created. [ 1194.578554] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.579143] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.579143] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.579293] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.579482] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.579756] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-98a76752-fbc0-461b-adfb-4b3b722d56e8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.252518] env[65678]: INFO networking_nsxv3.common.synchronization [req-49e313dc-6796-4f8f-929b-f65459497888 req-1bbad0dc-bd41-465a-b18f-fb31fc8fdfae service nova] Enqueued Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_rules [ 1195.252704] env[65678]: INFO networking_nsxv3.common.synchronization [req-49e313dc-6796-4f8f-929b-f65459497888 req-1bbad0dc-bd41-465a-b18f-fb31fc8fdfae service nova] Enqueued Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_members [ 1195.252839] env[65678]: INFO networking_nsxv3.common.synchronization [req-49e313dc-6796-4f8f-929b-f65459497888 req-1bbad0dc-bd41-465a-b18f-fb31fc8fdfae service nova] Enqueued Resource ID: 98a76752-fbc0-461b-adfb-4b3b722d56e8 with Priority: HIGHEST for action port [ 1195.253424] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_rules [ 1195.253563] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_members [ 1195.253661] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98a76752-fbc0-461b-adfb-4b3b722d56e8 with Priority: HIGHEST for action port [ 1195.253925] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.254177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.254262] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.254472] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.254555] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.256649] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.256649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.256649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.256649] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.256649] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.258036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.258036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.258036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.258036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.258036] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.258968] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-98a76752-fbc0-461b-adfb-4b3b722d56e8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.259093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98a76752-fbc0-461b-adfb-4b3b722d56e8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.262510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98a76752-fbc0-461b-adfb-4b3b722d56e8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.262510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98a76752-fbc0-461b-adfb-4b3b722d56e8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.262510] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98a76752-fbc0-461b-adfb-4b3b722d56e8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.517750] env[65678]: INFO networking_nsxv3.common.synchronization [req-93aaf26f-473d-41ce-8e61-b535025923bb req-da6575fd-ba52-4dd4-a021-e3cd3b88679a tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 1195.518418] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 1195.519015] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.519242] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.519399] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.520125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.520125] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.520125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.520125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.520367] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.520786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.520786] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.594513] env[65678]: INFO networking_nsxv3.common.synchronization [req-8710d879-c85e-4dc1-9c93-85443b322cac req-7c04ebe9-02c1-4b37-a7b7-267eab7765e9 tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1195.595081] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1195.595388] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.595511] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.595654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.595887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.596243] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.596243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.596243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.596382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.596427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.596517] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.757469] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.757704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.759087] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.762116] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98a76752-fbc0-461b-adfb-4b3b722d56e8 with status ACTIVE [ 1195.762116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.762116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.762116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.763624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.763624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.763895] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.764154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.764227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.764467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.764612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.764885] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.765054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.765167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.765387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.765489] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.765839] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98a76752-fbc0-461b-adfb-4b3b722d56e8 is going to be updated. [ 1195.798455] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.798686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.798686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.798783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.798922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.799100] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98a76752-fbc0-461b-adfb-4b3b722d56e8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.023392] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.099499] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.099687] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.099729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.100048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.100201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.100418] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.100525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.100579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.100747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.100826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.100915] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1196.135527] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.135740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.135740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.136024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.136135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.145807] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1196.174299] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1196.174460] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.262384] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.526805] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.765696] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.765696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.765696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.765696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.765696] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.765696] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc is going to be created. [ 1196.789949] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.790185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.790185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.790374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.790531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.799610] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc in Status: UNINITIALIZED for 2s [ 1197.029576] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.029844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.029976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.030235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.030335] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.030452] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 is going to be updated. [ 1197.082864] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.082864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.082864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.082864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.082864] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.103989] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: IN_PROGRESS for 2s [ 1198.158124] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1198.158124] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 deletion is rescheduled due to dependency. [ 1198.158124] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.810369] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc in Status: SUCCESS [ 1198.810611] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.810779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.811074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.811331] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.811456] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.811523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.811775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.811900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.812019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.812116] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.115854] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: SUCCESS [ 1199.116127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.314185] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.816218] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19c6e48f-d229-4770-b4c7-fb4b77bd07bc: rpc.has_security_group_logging(os_id): False [ 1199.835943] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.836181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.836181] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.836395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.836493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.836724] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.836818] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.836959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.837145] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.837225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.837306] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc is going to be created. [ 1199.907370] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.907586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.907586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.907830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.908026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.920485] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc in Status: IN_PROGRESS for 2s [ 1200.596289] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.596574] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1200.981686] env[65678]: INFO networking_nsxv3.common.synchronization [req-7d0a791a-dc44-42b1-9f9e-7f966f3ae974 req-5e97ad59-dde1-4bcc-bc88-3ebd25903c32 tempest-ServersTestJSON-1597198023 tempest-ServersTestJSON-1597198023-project-member] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1200.982515] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGHEST for action security_group_members [ 1200.982994] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-79cab93f-aae5-467c-88f3-35382c30a4ef taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.983227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.983520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.983659] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.983967] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.984132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.984278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.984412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.984548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.984663] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79cab93f-aae5-467c-88f3-35382c30a4ef',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.222467] env[65678]: INFO networking_nsxv3.common.synchronization [req-03096c51-821b-47c2-82f9-df190f020b41 req-f453549b-737d-47f0-8dbe-a1c14aca73b1 tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1201.222991] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1201.223310] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.223433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.223500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.223836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.223990] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.224099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.224155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.224305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.224391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.224483] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.489299] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.489448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.489519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.489757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.489851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.490068] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.490315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.490395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.490577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.490704] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.490821] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef is going to be updated. [ 1201.534659] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.534847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.534885] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.535093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.535447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.549967] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: IN_PROGRESS for 2s [ 1201.614027] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.614027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.614027] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.614535] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.614667] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.614831] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.614946] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.615187] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.615326] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.615530] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.615641] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.615745] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.615849] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.615956] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.616071] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.616201] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.644076] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.644076] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1201.644076] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.644412] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-660" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.644675] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-3439a3fc-3348-4f68-b826-c9e8d3a8227f taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.644894] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-3439a3fc-3348-4f68-b826-c9e8d3a8227f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.645074] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-3439a3fc-3348-4f68-b826-c9e8d3a8227f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.645441] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-3439a3fc-3348-4f68-b826-c9e8d3a8227f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.645654] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3439a3fc-3348-4f68-b826-c9e8d3a8227f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.726376] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.726470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.726542] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.726767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.726859] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.727087] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.727191] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.727254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.727404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.727479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.727565] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1201.757700] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.757910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.758032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.758275] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.758423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.768700] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1201.939024] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc in Status: SUCCESS [ 1201.939024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.148110] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.148336] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.148464] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.148745] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.148915] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.149081] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port 3439a3fc-3348-4f68-b826-c9e8d3a8227f not found, creating... [ 1202.149342] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.149496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.149609] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.149830] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.149967] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.150263] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.150410] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.150525] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.150735] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.150851] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.150989] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: 3439a3fc-3348-4f68-b826-c9e8d3a8227f is going to be created. [ 1202.176406] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.176524] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.176595] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.176848] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.177147] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.177398] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-3439a3fc-3348-4f68-b826-c9e8d3a8227f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.898778] env[65678]: INFO networking_nsxv3.common.synchronization [req-03096c51-821b-47c2-82f9-df190f020b41 req-53a1a27f-8b3b-4b40-a17c-a5f90f6021e6 service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1202.898778] env[65678]: INFO networking_nsxv3.common.synchronization [req-03096c51-821b-47c2-82f9-df190f020b41 req-53a1a27f-8b3b-4b40-a17c-a5f90f6021e6 service nova] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1202.899310] env[65678]: INFO networking_nsxv3.common.synchronization [req-03096c51-821b-47c2-82f9-df190f020b41 req-53a1a27f-8b3b-4b40-a17c-a5f90f6021e6 service nova] Enqueued Resource ID: 3439a3fc-3348-4f68-b826-c9e8d3a8227f with Priority: HIGHEST for action port [ 1202.899552] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_rules [ 1202.899706] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1202.899781] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3439a3fc-3348-4f68-b826-c9e8d3a8227f with Priority: HIGHEST for action port [ 1202.900212] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.900356] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.900433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.900632] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.900712] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.902582] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.902686] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.902893] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3439a3fc-3348-4f68-b826-c9e8d3a8227f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.902997] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3439a3fc-3348-4f68-b826-c9e8d3a8227f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.903075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3439a3fc-3348-4f68-b826-c9e8d3a8227f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.903421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3439a3fc-3348-4f68-b826-c9e8d3a8227f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.903507] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3439a3fc-3348-4f68-b826-c9e8d3a8227f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.403079] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.403228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.405605] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3439a3fc-3348-4f68-b826-c9e8d3a8227f with status ACTIVE [ 1203.406020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.406165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.407594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.407594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.407594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.407594] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.407594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.407594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.407594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.407594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.407594] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.408155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.408155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.408238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.408278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.408363] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3439a3fc-3348-4f68-b826-c9e8d3a8227f is going to be updated. [ 1203.431196] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.431365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.431439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.431656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.431823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.432014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3439a3fc-3348-4f68-b826-c9e8d3a8227f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.561512] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79cab93f-aae5-467c-88f3-35382c30a4ef in Status: SUCCESS [ 1203.561650] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79cab93f-aae5-467c-88f3-35382c30a4ef deletion is rescheduled due to dependency. [ 1203.561764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79cab93f-aae5-467c-88f3-35382c30a4ef" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.778802] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1203.779032] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1203.779196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.779598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.779598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.779708] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.779795] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.779861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.780014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.780159] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.780255] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.282267] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.784742] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.274267] env[65678]: INFO networking_nsxv3.common.synchronization [req-d23f4bf0-50ef-4e60-81d4-6542ba788534 req-1109eb1a-2389-40f9-afc2-37ae7c095639 tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1205.274863] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1205.275357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.275549] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.275624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.275947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.276043] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.276160] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.276254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.276723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.276723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.276723] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.287426] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.287775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.287775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.288765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.288765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.288765] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1205.335346] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.335346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.335346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.335346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.335346] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.344690] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1205.606339] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.606339] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.606339] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.606339] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.606339] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.606339] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.606339] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.608211] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.608211] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.608211] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1205.608211] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1205.608211] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1205.608211] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1205.608211] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1205.608211] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1205.608609] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1205.631116] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1205.631342] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1205.631482] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1205.631661] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-51" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.631996] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-46d9b90b-405d-4f31-b83e-96e5955305ba taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.632176] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-46d9b90b-405d-4f31-b83e-96e5955305ba" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.632297] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-46d9b90b-405d-4f31-b83e-96e5955305ba" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.632678] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-46d9b90b-405d-4f31-b83e-96e5955305ba" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.632815] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46d9b90b-405d-4f31-b83e-96e5955305ba',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.781492] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.781658] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.781720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.783081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.783249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.783480] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.783596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.783671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.783825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.783983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.783983] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1205.912337] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.912337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.912563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.912626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.912768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.925991] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1206.136285] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.136513] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.136641] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.136930] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.137088] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.137244] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port 46d9b90b-405d-4f31-b83e-96e5955305ba not found, creating... [ 1206.137498] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.137651] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.137776] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.138063] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.138213] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.138511] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.138690] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.138813] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.139077] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.139221] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.139363] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: 46d9b90b-405d-4f31-b83e-96e5955305ba is going to be created. [ 1206.165626] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.165917] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.166090] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.166367] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.166588] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.166811] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-46d9b90b-405d-4f31-b83e-96e5955305ba" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.855794] env[65678]: INFO networking_nsxv3.common.synchronization [req-d23f4bf0-50ef-4e60-81d4-6542ba788534 req-75dfe1b7-1e41-4b0c-a2e8-c0ac9ea812af service nova] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 1206.856073] env[65678]: INFO networking_nsxv3.common.synchronization [req-d23f4bf0-50ef-4e60-81d4-6542ba788534 req-75dfe1b7-1e41-4b0c-a2e8-c0ac9ea812af service nova] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1206.856208] env[65678]: INFO networking_nsxv3.common.synchronization [req-d23f4bf0-50ef-4e60-81d4-6542ba788534 req-75dfe1b7-1e41-4b0c-a2e8-c0ac9ea812af service nova] Enqueued Resource ID: 46d9b90b-405d-4f31-b83e-96e5955305ba with Priority: HIGHEST for action port [ 1206.856848] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_rules [ 1206.856992] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1206.857863] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46d9b90b-405d-4f31-b83e-96e5955305ba with Priority: HIGHEST for action port [ 1206.857863] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.858755] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.859351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.859351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.859351] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.861048] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.861048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.861048] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-46d9b90b-405d-4f31-b83e-96e5955305ba taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.861310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46d9b90b-405d-4f31-b83e-96e5955305ba" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.861310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46d9b90b-405d-4f31-b83e-96e5955305ba" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.861424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46d9b90b-405d-4f31-b83e-96e5955305ba" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.861476] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46d9b90b-405d-4f31-b83e-96e5955305ba',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.355829] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1207.356205] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.356514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.356809] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.357070] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.357273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.357392] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.357638] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.358069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.358069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.358069] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.365568] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46d9b90b-405d-4f31-b83e-96e5955305ba with status ACTIVE [ 1207.365817] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.365940] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.365993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.366203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.366293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.366469] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.366569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.366648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.366810] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.366882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.367073] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.367267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.367267] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.367415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.367528] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.367528] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46d9b90b-405d-4f31-b83e-96e5955305ba is going to be updated. [ 1207.368649] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.368743] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.389411] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.389551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.389624] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.389836] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.390028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.390229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46d9b90b-405d-4f31-b83e-96e5955305ba" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.860369] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.860654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.860654] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.860875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.861102] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.861223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.861291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.861484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.861587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.861716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.861883] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.861983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.862069] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.862227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.862369] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.862464] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.862525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.862663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.862736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.862816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.862907] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.936900] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1207.937127] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 deletion is rescheduled due to dependency. [ 1207.937254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.937433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.937685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.937873] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.938074] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.938174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.938365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.938469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.938574] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.365918] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50c43a13-ebd7-47b2-924e-039a5d7a4354: rpc.has_security_group_logging(os_id): False [ 1208.385349] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.385529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.385587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.385892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.386031] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.386286] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.386446] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.386496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.386685] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.387030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.387030] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.387129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.387161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.387326] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.387419] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.387757] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.387891] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.387953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.388157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.388439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.388439] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1208.440547] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.466860] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.467118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.467118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.467296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.467439] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.489773] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1208.943081] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.446561] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.446715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.446785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.447035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.447143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.447234] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1209.499366] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.499615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.499747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.500132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.500374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.523806] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1210.511493] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1210.511777] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.535055] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1211.535471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.535471] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.535587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.535781] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.535935] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.536090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.536177] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.536255] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.536341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.536429] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.858492] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1211.858718] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1212.039045] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.494167] env[65678]: INFO networking_nsxv3.common.synchronization [req-bf94bdf0-4901-4ddb-af23-c032d6b71483 req-e14f53d7-a267-40d1-aafe-421e50330059 tempest-ServerActionsTestOtherA-1746218147 tempest-ServerActionsTestOtherA-1746218147-project-member] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 1212.494361] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGHEST for action security_group_members [ 1212.494661] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.494785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.494852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.495115] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.495282] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.495381] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.495477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.495612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.495714] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.495809] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.543322] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9844dc2-a792-4762-9b70-e918899f67f5: rpc.has_security_group_logging(os_id): False [ 1212.565613] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.565800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.565800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.566048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.566162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.566462] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.566569] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.566647] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.566850] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.566961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.567072] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1212.637835] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.638138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.638138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.638368] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.638561] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.656361] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1212.997934] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.998207] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.998423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.998582] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.998703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.998948] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.999111] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.999200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.999408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.999689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.999689] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 is going to be updated. [ 1213.034402] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.034700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.034700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.034863] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.034953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.046185] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: IN_PROGRESS for 2s [ 1214.672099] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1214.672827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.056776] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 961e8451-f48b-412a-8046-631c24d72fe5 in Status: SUCCESS [ 1215.056972] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 deletion is rescheduled due to dependency. [ 1215.057093] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.495661] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.496065] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1220.906101] env[65678]: INFO networking_nsxv3.common.synchronization [None req-68906369-074b-4dbf-b70c-984a3861d4a0 None None] Enqueued Resource ID: fb5e94f6-e8d5-427a-bceb-69fcd14436bf with Priority: HIGHEST for action port [ 1220.906706] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb5e94f6-e8d5-427a-bceb-69fcd14436bf with Priority: HIGHEST for action port [ 1220.907162] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb5e94f6-e8d5-427a-bceb-69fcd14436bf taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.907285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb5e94f6-e8d5-427a-bceb-69fcd14436bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.907374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb5e94f6-e8d5-427a-bceb-69fcd14436bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.907636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb5e94f6-e8d5-427a-bceb-69fcd14436bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.907682] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5e94f6-e8d5-427a-bceb-69fcd14436bf',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.411116] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb5e94f6-e8d5-427a-bceb-69fcd14436bf [ 1221.411116] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.411116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.411292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.411913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.411913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.411913] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb5e94f6-e8d5-427a-bceb-69fcd14436bf already deleted. [ 1221.411913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb5e94f6-e8d5-427a-bceb-69fcd14436bf" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.155084] env[65678]: INFO networking_nsxv3.common.synchronization [None req-671856a1-52a6-424c-bfe1-f98a806e1113 None None] Enqueued Resource ID: 0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f with Priority: HIGHEST for action port [ 1223.155704] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f with Priority: HIGHEST for action port [ 1223.156024] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.156172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.156271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.156587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.156673] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.658716] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f [ 1223.658966] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.659118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.659189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.659442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.659539] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.659740] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f already deleted. [ 1223.659890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0342b02f-5dd5-43ca-9fd4-e2a3a1d0ec5f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.425574] env[65678]: INFO networking_nsxv3.common.synchronization [req-4e0729ec-c9a3-40a8-8523-5d3985326349 req-8df615bc-15b1-4a3f-9e22-454bfe430797 tempest-ServerRescueTestJSON-599010838 tempest-ServerRescueTestJSON-599010838-project-member] Enqueued Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1226.426369] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1226.426977] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.426977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.426977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.427336] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.427511] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.427618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.427681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.427843] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.427932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.428044] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.733133] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-157 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.733341] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-157" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.733473] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-157" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.733910] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-157" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.734210] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.734375] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.734491] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.734711] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.734850] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.735078] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1226.735194] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.735308] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.735461] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.735613] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1226.735728] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.735859] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.757330] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.757502] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1226.757621] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.757796] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-157" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.758297] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.758514] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.758638] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.758954] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.759108] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf108b2c-4472-49d9-9f3d-5ad1352dfff0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.930415] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.930662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.930662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.930901] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.930982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.931241] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.931347] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.931412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.931570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.931643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.931729] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f already deleted. [ 1226.931811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.261410] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.261655] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.261732] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.262026] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.262183] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.262339] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port cf108b2c-4472-49d9-9f3d-5ad1352dfff0 not found, creating... [ 1227.262595] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.262754] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.262893] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.263127] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.263263] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.263538] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.263691] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.263806] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.264015] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.264153] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.264288] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: cf108b2c-4472-49d9-9f3d-5ad1352dfff0 is going to be created. [ 1227.286023] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.286340] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.286427] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.286716] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.287089] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.287398] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.011383] env[65678]: INFO networking_nsxv3.common.synchronization [req-4e0729ec-c9a3-40a8-8523-5d3985326349 req-2848e0fd-7cc1-4558-8ae2-33871953599c service nova] Enqueued Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_rules [ 1228.011742] env[65678]: INFO networking_nsxv3.common.synchronization [req-4e0729ec-c9a3-40a8-8523-5d3985326349 req-2848e0fd-7cc1-4558-8ae2-33871953599c service nova] Enqueued Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1228.011742] env[65678]: INFO networking_nsxv3.common.synchronization [req-4e0729ec-c9a3-40a8-8523-5d3985326349 req-2848e0fd-7cc1-4558-8ae2-33871953599c service nova] Enqueued Resource ID: cf108b2c-4472-49d9-9f3d-5ad1352dfff0 with Priority: HIGHEST for action port [ 1228.013487] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_rules [ 1228.013648] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1228.013775] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf108b2c-4472-49d9-9f3d-5ad1352dfff0 with Priority: HIGHEST for action port [ 1228.014092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.014208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.014284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.014683] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.014760] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.015740] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.015825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.015865] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.016138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.016231] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.016299] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.016338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.016475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.016563] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.016653] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.017792] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.018835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.018835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.018835] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.018835] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf108b2c-4472-49d9-9f3d-5ad1352dfff0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.519575] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.519848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.521052] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.521956] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf108b2c-4472-49d9-9f3d-5ad1352dfff0 with status ACTIVE [ 1228.522155] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.522288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.522375] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.522527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.522615] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.522818] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.522932] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.522987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.523150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.523227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.523406] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.523487] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.523551] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.523711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.523758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.523839] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf108b2c-4472-49d9-9f3d-5ad1352dfff0 is going to be updated. [ 1228.548824] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.549064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.549064] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.549244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.549412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.549586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf108b2c-4472-49d9-9f3d-5ad1352dfff0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.026634] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.530095] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.530095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.530095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.530095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.530431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.530431] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f is going to be created. [ 1229.559126] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.559353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.559353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.559628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.559783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.570020] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: UNINITIALIZED for 2s [ 1231.581778] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: SUCCESS [ 1231.582189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.582189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.582408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.582612] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.582759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.582822] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.582983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.583076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.583162] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.583254] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.085401] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.085592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.085689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.086054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.086171] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.086291] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.086383] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.086627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.086749] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.086827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.086993] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.087110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.087168] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.087382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.087572] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.087677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.087732] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.087880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.087980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.088135] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.088276] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.590987] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c74220d-3082-48cf-9655-7a8161bde38f: rpc.has_security_group_logging(os_id): False [ 1232.610528] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.610719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.610758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.610983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.611112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.611316] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.611578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.611665] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.611862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.612084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.612304] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.612378] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.612415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.612606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.612692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.612907] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.613099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.613099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.613278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.613351] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.613440] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f is going to be created. [ 1232.722853] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.722853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.722853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.722853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.723200] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.740303] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: IN_PROGRESS for 2s [ 1233.015232] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1233.015383] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1234.757508] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: SUCCESS [ 1234.757768] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.915479] env[65678]: INFO networking_nsxv3.common.synchronization [req-19860a59-e59b-4b61-bf7d-8b9313c232ef req-22ff6d66-f20a-4ba1-9899-c742bbd8d291 tempest-AttachVolumeTestJSON-242852111 tempest-AttachVolumeTestJSON-242852111-project-member] Enqueued Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_members [ 1235.915479] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGHEST for action security_group_members [ 1235.915479] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-57fdce9f-904c-425a-b6d4-0a58e3578508 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.915479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.915479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.915479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.915479] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.915479] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.916268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.916268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.916268] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.916268] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.419033] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.419033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.419033] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.419357] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.419554] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.419732] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.419837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.419896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.420075] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.420153] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.420239] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 is going to be updated. [ 1236.452315] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.452496] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.452580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.452848] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.453048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.462862] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 in Status: IN_PROGRESS for 2s [ 1238.474619] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 in Status: SUCCESS [ 1238.475729] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 deletion is rescheduled due to dependency. [ 1238.475896] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.916918] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.916918] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1243.387134] env[65678]: INFO networking_nsxv3.common.synchronization [req-6d2517d7-2b21-49b9-b160-9847f416ec05 req-8a599ace-330b-4b70-8212-78a87ce5ed66 tempest-DeleteServersTestJSON-994729214 tempest-DeleteServersTestJSON-994729214-project-member] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1243.387977] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGHEST for action security_group_members [ 1243.388453] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.388648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.388756] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.389047] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.389276] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.389421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.389519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.389766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.390127] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.390127] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.894099] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.894099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.894099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.894413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.894413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.894550] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.894672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.894740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.894900] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.894979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.895102] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be updated. [ 1243.934042] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.934272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.934330] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.934603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.934784] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.947869] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: IN_PROGRESS for 2s [ 1245.962760] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 in Status: SUCCESS [ 1245.962760] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 deletion is rescheduled due to dependency. [ 1245.962760] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.210579] env[65678]: INFO networking_nsxv3.common.synchronization [req-7f253eec-610e-40af-ab0a-4ea0e07879e5 req-686d5894-5de4-4192-b2aa-f6d2ebec07cd tempest-ServerActionsV293TestJSON-1224759286 tempest-ServerActionsV293TestJSON-1224759286-project-member] Enqueued Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_members [ 1247.211096] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGHEST for action security_group_members [ 1247.211520] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.211663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.211740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.211915] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.212656] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.212917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.213038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.213225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.213319] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.213421] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.716092] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.716320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.716411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.716693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.716820] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.717077] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.717196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.717264] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.717442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.717535] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.717630] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc is going to be updated. [ 1247.757283] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.757519] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.757613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.757914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.758490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.770741] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc in Status: IN_PROGRESS for 2s [ 1249.783765] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc in Status: SUCCESS [ 1249.784092] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc deletion is rescheduled due to dependency. [ 1249.784092] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.783555] env[65678]: INFO networking_nsxv3.common.synchronization [req-675e3154-fb03-40be-8579-7cf036ec6efb req-3344513f-1b41-4730-b8a1-652562529796 tempest-ServerRescueTestJSON-599010838 tempest-ServerRescueTestJSON-599010838-project-member] Enqueued Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1250.784154] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1250.784462] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.784719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.784719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.784869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.785045] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.785149] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.785211] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.785365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.785448] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.785540] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.166063] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-157 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.166275] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-157" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.166421] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-157" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.166740] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-157" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.167029] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.167190] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.167308] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.167528] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.167674] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.167896] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.168035] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.168158] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.168284] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.168435] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.168564] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.168783] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.189099] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.189335] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1251.189527] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.189760] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-157" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.190152] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-c32fedb4-69f7-4eaa-8989-90a8479eafa7 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.190336] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-c32fedb4-69f7-4eaa-8989-90a8479eafa7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.190450] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-c32fedb4-69f7-4eaa-8989-90a8479eafa7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.190756] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-c32fedb4-69f7-4eaa-8989-90a8479eafa7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.190890] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c32fedb4-69f7-4eaa-8989-90a8479eafa7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.287116] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.693226] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.693451] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.695970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.695970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.695970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.695970] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port c32fedb4-69f7-4eaa-8989-90a8479eafa7 not found, creating... [ 1251.695970] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.695970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.695970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.695970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.695970] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.695970] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.696475] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.696475] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.696475] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.696475] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.696582] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: c32fedb4-69f7-4eaa-8989-90a8479eafa7 is going to be created. [ 1251.719047] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.719047] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.719047] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.719303] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.719352] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.719572] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-c32fedb4-69f7-4eaa-8989-90a8479eafa7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.789509] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.292288] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.292692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.292692] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.292769] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.292807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.292907] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f is going to be updated. [ 1252.325716] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.326295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.326295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.326295] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.326495] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.336994] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: IN_PROGRESS for 2s [ 1252.439217] env[65678]: INFO networking_nsxv3.common.synchronization [req-675e3154-fb03-40be-8579-7cf036ec6efb req-9ca37196-66f6-4049-8fc7-8dd16362681c service nova] Enqueued Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_rules [ 1252.439217] env[65678]: INFO networking_nsxv3.common.synchronization [req-675e3154-fb03-40be-8579-7cf036ec6efb req-9ca37196-66f6-4049-8fc7-8dd16362681c service nova] Enqueued Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1252.439217] env[65678]: INFO networking_nsxv3.common.synchronization [req-675e3154-fb03-40be-8579-7cf036ec6efb req-9ca37196-66f6-4049-8fc7-8dd16362681c service nova] Enqueued Resource ID: c32fedb4-69f7-4eaa-8989-90a8479eafa7 with Priority: HIGHEST for action port [ 1252.439811] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_rules [ 1252.439878] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1252.439968] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c32fedb4-69f7-4eaa-8989-90a8479eafa7 with Priority: HIGHEST for action port [ 1252.440395] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.440520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.440588] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.440785] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.440996] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.442154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.442361] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.442579] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-c32fedb4-69f7-4eaa-8989-90a8479eafa7 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.442695] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c32fedb4-69f7-4eaa-8989-90a8479eafa7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.442737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c32fedb4-69f7-4eaa-8989-90a8479eafa7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.442908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c32fedb4-69f7-4eaa-8989-90a8479eafa7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.442993] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c32fedb4-69f7-4eaa-8989-90a8479eafa7',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.942687] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.943040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.945208] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c32fedb4-69f7-4eaa-8989-90a8479eafa7 with status ACTIVE [ 1252.945434] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.945571] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.945655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.945913] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.946034] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.946220] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.946315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.946376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.946548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.946628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.946818] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.946908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.946970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.947129] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.947201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.947284] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c32fedb4-69f7-4eaa-8989-90a8479eafa7 is going to be updated. [ 1252.969496] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.969652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.969698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.969931] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.970090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.970254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c32fedb4-69f7-4eaa-8989-90a8479eafa7" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.348427] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: SUCCESS [ 1254.348427] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.349085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.349085] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.349244] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.349376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.349442] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.349706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.349820] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.349927] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.852381] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.354698] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.858086] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.858086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.858086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.858086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.858086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.858086] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f is going to be updated. [ 1255.890833] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.891030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.891113] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.891315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.891453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.905555] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: IN_PROGRESS for 2s [ 1257.440968] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.441437] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1257.917281] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: SUCCESS [ 1257.917503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.917671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.917882] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.918089] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.918210] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.918278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.918432] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.918514] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.918599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.918686] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.423020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.423020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.423020] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.423020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.423677] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.423677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.423677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.423677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.423677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.423677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.423869] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.741546] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1258.741976] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent loop - iteration:3 started [ 1258.928540] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c74220d-3082-48cf-9655-7a8161bde38f: rpc.has_security_group_logging(os_id): False [ 1258.949595] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.949595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.949595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.949890] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.949996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.950311] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.950486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.950578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.950807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.950909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.951159] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.951278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.951385] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.951574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.951657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.952044] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.952044] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.952235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.952235] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.952321] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.952362] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f is going to be updated. [ 1259.021508] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.022294] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.022397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.022566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.022728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.039850] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: IN_PROGRESS for 2s [ 1261.064636] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: SUCCESS [ 1261.065081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.442384] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.442384] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1267.443173] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.443569] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1269.332676] env[65678]: INFO networking_nsxv3.common.synchronization [req-7ac2ec9c-7ec1-4f7b-8736-bd0cfb9fbb63 req-a2cb8a93-f8bd-4f4c-bf97-1f2aa97ba835 tempest-ServerActionsTestJSON-1078547311 tempest-ServerActionsTestJSON-1078547311-project-member] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1269.332967] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGHEST for action security_group_members [ 1269.333257] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.333529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.333578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.334185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.334185] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.334185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.334185] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.334476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.334476] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.334476] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.838669] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.838873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.838873] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.838992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.839136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.839342] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.839443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.839505] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.839656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.839731] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.839816] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be updated. [ 1269.869646] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.869876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.869876] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.870080] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.870248] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.878746] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: IN_PROGRESS for 2s [ 1271.890686] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9844dc2-a792-4762-9b70-e918899f67f5 in Status: SUCCESS [ 1271.890993] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 deletion is rescheduled due to dependency. [ 1271.890993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.333769] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.333769] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1276.529238] env[65678]: INFO networking_nsxv3.common.synchronization [req-48f01c2f-ab07-4858-8943-54328b534a6c req-aea40568-0c70-4e6c-98ed-1d12764bc01e tempest-ServerRescueTestJSON-599010838 tempest-ServerRescueTestJSON-599010838-project-member] Enqueued Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1276.529768] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1276.530080] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.530223] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.530310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.530501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.530648] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.530745] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.530802] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.530947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.531040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.531132] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.033839] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.536371] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.836204] env[65678]: INFO networking_nsxv3.common.synchronization [None req-cb29c0bf-ce7e-413b-b81a-2fdeba750a69 None None] Enqueued Resource ID: 991361be-6843-4132-b559-15139f22100e with Priority: HIGHEST for action port [ 1277.836204] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 991361be-6843-4132-b559-15139f22100e with Priority: HIGHEST for action port [ 1277.836204] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-991361be-6843-4132-b559-15139f22100e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.836204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-991361be-6843-4132-b559-15139f22100e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.836204] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-991361be-6843-4132-b559-15139f22100e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.836527] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-991361be-6843-4132-b559-15139f22100e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.836716] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('991361be-6843-4132-b559-15139f22100e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.038381] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.038530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.038630] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.038844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.038917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.039184] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f is going to be updated. [ 1278.080728] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.080728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.080728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.080728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.080728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.091219] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: IN_PROGRESS for 2s [ 1278.339359] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 991361be-6843-4132-b559-15139f22100e [ 1278.339455] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.339605] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.339651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.339908] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.339979] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.340500] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:991361be-6843-4132-b559-15139f22100e already deleted. [ 1278.340500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-991361be-6843-4132-b559-15139f22100e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.594747] env[65678]: INFO networking_nsxv3.common.synchronization [None req-6fedb07f-e01f-42ca-8c77-2b3208103018 None None] Enqueued Resource ID: 3cbbc504-ede2-4474-bc88-276067df0ebb with Priority: HIGHEST for action port [ 1279.595298] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cbbc504-ede2-4474-bc88-276067df0ebb with Priority: HIGHEST for action port [ 1279.595594] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cbbc504-ede2-4474-bc88-276067df0ebb taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.595716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cbbc504-ede2-4474-bc88-276067df0ebb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.595783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cbbc504-ede2-4474-bc88-276067df0ebb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.596045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cbbc504-ede2-4474-bc88-276067df0ebb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.596128] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cbbc504-ede2-4474-bc88-276067df0ebb',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.098871] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cbbc504-ede2-4474-bc88-276067df0ebb [ 1280.099121] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.099339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.099443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.099691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.099811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.099948] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cbbc504-ede2-4474-bc88-276067df0ebb already deleted. [ 1280.100086] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cbbc504-ede2-4474-bc88-276067df0ebb" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.103300] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: SUCCESS [ 1280.103526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.261572] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca0aa25d-eac1-48ec-a8f9-2e58f7ac2c1c req-58cbf1f3-0d68-4943-aa84-1b950278eaf4 tempest-ServersNegativeTestJSON-196663710 tempest-ServersNegativeTestJSON-196663710-project-member] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1283.262128] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1283.262455] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.262581] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.262648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.262903] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.264228] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.264366] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.264429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.264595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.264814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.264814] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.271762] env[65678]: INFO networking_nsxv3.common.synchronization [req-984ec014-35a7-44ea-9a1c-11379f3e717d req-e7abfe3c-ba05-43bc-9c7d-edc1b4b51e3c tempest-ServerRescueTestJSON-599010838 tempest-ServerRescueTestJSON-599010838-project-member] Enqueued Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1283.272279] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGHEST for action security_group_members [ 1283.272619] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.272729] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.272816] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.273015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.273180] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.273279] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.273341] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.273483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.274327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.274327] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.556165] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.556366] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.556517] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.556844] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.557419] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.557636] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.557783] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.558011] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.558305] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.558521] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1283.558635] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1283.558743] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1283.558849] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1283.558955] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1283.559071] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1283.559201] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1283.581313] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1283.581496] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1283.581552] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1283.581707] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.582017] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-fcf3f60e-abd8-4304-a6db-a11c6b63a725 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.582196] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.582313] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.582622] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.582761] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcf3f60e-abd8-4304-a6db-a11c6b63a725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.767926] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.767926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.767926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.768157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.768157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.768246] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.768345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.768407] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.768556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.768629] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.768713] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 already deleted. [ 1283.768791] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.777356] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.777530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.777572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.777741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.777824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.778017] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.778161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.778161] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.778313] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.778393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.778475] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f is going to be updated. [ 1283.806847] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.807066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.807134] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.807314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.807458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.818802] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: IN_PROGRESS for 2s [ 1284.085215] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.085439] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.085567] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.085853] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.086009] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.086167] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port fcf3f60e-abd8-4304-a6db-a11c6b63a725 not found, creating... [ 1284.086421] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.086576] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.086690] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.086906] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.087049] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.087357] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.087551] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.087672] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.087904] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.088024] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.088163] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: fcf3f60e-abd8-4304-a6db-a11c6b63a725 is going to be created. [ 1284.111266] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.111484] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.111612] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.111886] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.112132] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.112372] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.242288] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca0aa25d-eac1-48ec-a8f9-2e58f7ac2c1c req-daa684d4-dfb4-4222-84d0-3f89edd5a710 service nova] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_rules [ 1285.242575] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca0aa25d-eac1-48ec-a8f9-2e58f7ac2c1c req-daa684d4-dfb4-4222-84d0-3f89edd5a710 service nova] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1285.242615] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca0aa25d-eac1-48ec-a8f9-2e58f7ac2c1c req-daa684d4-dfb4-4222-84d0-3f89edd5a710 service nova] Enqueued Resource ID: fcf3f60e-abd8-4304-a6db-a11c6b63a725 with Priority: HIGHEST for action port [ 1285.243120] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_rules [ 1285.243256] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1285.243350] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf3f60e-abd8-4304-a6db-a11c6b63a725 with Priority: HIGHEST for action port [ 1285.243619] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.243741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.243807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.244066] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.244143] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.245357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.245485] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.245572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.245725] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.245869] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.246136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.246136] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.246272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.246272] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.246329] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.247119] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcf3f60e-abd8-4304-a6db-a11c6b63a725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.247227] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.247334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.247434] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.247508] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcf3f60e-abd8-4304-a6db-a11c6b63a725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.749372] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.749578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.749689] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.750592] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcf3f60e-abd8-4304-a6db-a11c6b63a725 with status ACTIVE [ 1285.750769] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.750881] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.750991] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.751160] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.751249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.751413] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.751517] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.752087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.752087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.752087] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.752087] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.752293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.752293] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.752358] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.752462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.752499] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcf3f60e-abd8-4304-a6db-a11c6b63a725 is going to be updated. [ 1285.774727] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.774974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.774974] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.775076] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.775183] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.775334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.829206] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c74220d-3082-48cf-9655-7a8161bde38f in Status: SUCCESS [ 1285.829420] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f deletion is rescheduled due to dependency. [ 1285.829530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.254697] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.759594] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.759812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.759812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.760030] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.760121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.760221] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 is going to be created. [ 1286.784788] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.785036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.785036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.785203] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.785374] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.795981] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: UNINITIALIZED for 2s [ 1288.808487] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: SUCCESS [ 1288.808808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.808849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.809068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.809261] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.809398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.809462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.809628] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.809711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.809817] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.809927] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.312930] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.313169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.313169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.313338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.313503] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.313600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.313663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.313838] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.313924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.314019] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.314170] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.314261] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.314342] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.314484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.314610] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.314698] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.314757] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.314892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.314963] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.315054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.315146] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.817837] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd928ece-5917-427b-90dc-a2f5eb4dc3c8: rpc.has_security_group_logging(os_id): False [ 1289.835906] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.836108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.836170] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.836334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.836426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.836615] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.836711] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.836773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.836923] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.837014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.837228] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.837328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.837394] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.837544] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.837618] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.837795] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.837887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.837948] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.838096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.838167] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.838251] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 is going to be created. [ 1289.895405] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.895627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.895627] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.895823] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.896029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.907353] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: IN_PROGRESS for 2s [ 1290.244366] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.244595] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1291.920805] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: SUCCESS [ 1291.921220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.689221] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.689663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.689663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.689742] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.689808] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.192239] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.695054] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.197281] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1295.197529] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1295.245711] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.245930] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1295.992357] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.992790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.992790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.992790] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.006543] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1296.007418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.008210] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1296.050721] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.050964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.050964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.051196] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.064952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.065853] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1296.065946] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.066039] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1296.111365] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.111609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.111609] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.111783] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.113186] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.113396] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1296.185996] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.186254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.186307] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.186552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.186971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.187373] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1296.264290] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.264526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.264526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.264681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.265108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.265596] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1296.265596] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'02e933d1-ac0d-4baa-9da0-e149762ce926', 'e9844dc2-a792-4762-9b70-e918899f67f5', 'b3e6206b-217a-495f-93c5-643d3576e725', '57fdce9f-904c-425a-b6d4-0a58e3578508', '6d86ff68-550b-40c3-8567-854372ec34de', '6d205434-5ee2-4e1a-bee3-e65c424f311c', '530d93d3-1148-4ef5-af5b-5267dece0166', '50c43a13-ebd7-47b2-924e-039a5d7a4354', '961e8451-f48b-412a-8046-631c24d72fe5', '6c6b2ecc-4e9d-4daa-827c-44b5af68a366', '9687b7d1-a464-4878-ae3a-b131f314c98b', '6ed86dd0-f355-4dc0-9bd4-91be15af4d6d', 'aec1e262-a46a-4ce5-b4f8-1392575d0891', '433b7d9d-3978-4af8-a278-70a89b5d5f2e', '32f35a35-0102-4d28-a65d-3999b6041978', '1cf83cc4-cb38-45ef-a793-74322cc1b712', 'd196335c-3d4b-49d3-91d2-49ab0c720654', 'be0fa044-c782-451f-a03f-5161e22ff3ca', '19c6e48f-d229-4770-b4c7-fb4b77bd07bc', '6c74220d-3082-48cf-9655-7a8161bde38f', 'abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb', 'be3b7ec3-66f8-4175-9611-636d9a427a3e', 'a3b380ca-ae52-4449-89ca-b2e647b635d9', '4b06f75c-4a15-46fd-8850-579c633c71af', 'e857e4d2-27dd-462e-87df-ee44911ff684', '850ea458-7bc9-41b1-87fe-f961a64609eb', '6f8fce09-ff14-4f78-bcad-d1a722c00977', '0cad1a85-e250-44ba-929f-39b2137bd736', '2164111b-0060-40e2-86c3-edfc4931cb24', '3ca02848-c142-45aa-adca-5a1d75fe5bb6', 'cddb9167-1b9c-4751-8cf3-4f83a593874e', '802af02b-8ef5-41bb-a1fa-3f15ffa69531', '8631425e-c832-4434-9322-1536d9e46bb8', '394e9a35-6053-4366-8c10-efbb3bbed0b9', '4f236cc9-1bc2-44e5-b39b-04c5909837a7', '79cab93f-aae5-467c-88f3-35382c30a4ef', '365d72a1-5a30-4ddf-b653-b2fb3c894c63', '40537b9d-ed59-4875-a8af-108e1322d055', '5b13ea87-a34e-4663-aca7-94955d02166c', 'b634fd1e-f1ec-4189-ac44-9f8fa9578204', '6bf254fe-a02c-4c36-8f89-52a5a801f9b5', '8d58c068-3cf0-4038-b60f-b9591e0abf8a', '58d8edd9-578b-4843-bee9-3ea3ba7e5469', 'dd928ece-5917-427b-90dc-a2f5eb4dc3c8', 'cda39a55-69e8-4fac-bca6-eac8c60627f3', '4bcfce19-b3dc-46b9-a272-88acde866ff3'} {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.265596] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1296.283585] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.283830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.283830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.283999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.284098] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.284211] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1296.284280] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.284352] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1296.395833] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.396089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.396089] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.396263] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.397443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.397739] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1296.397818] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.397890] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1296.397956] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1296.398044] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1296.398116] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGH for action security_group_rules [ 1296.398196] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGH for action security_group_rules [ 1296.398263] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGH for action security_group_rules [ 1296.398326] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGH for action security_group_rules [ 1296.398378] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGH for action security_group_rules [ 1296.398442] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGH for action security_group_rules [ 1296.398503] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGH for action security_group_rules [ 1296.398590] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGH for action security_group_rules [ 1296.398648] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGH for action security_group_rules [ 1296.398685] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGH for action security_group_rules [ 1296.398729] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGH for action security_group_rules [ 1296.398790] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGH for action security_group_rules [ 1296.398850] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGH for action security_group_rules [ 1296.398910] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGH for action security_group_rules [ 1296.398969] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGH for action security_group_rules [ 1296.399042] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGH for action security_group_rules [ 1296.399104] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGH for action security_group_rules [ 1296.399165] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGH for action security_group_rules [ 1296.399226] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGH for action security_group_rules [ 1296.399287] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGH for action security_group_rules [ 1296.399384] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.451163] env[65678]: INFO networking_nsxv3.common.synchronization [req-b5cf33e5-c445-48c1-b40b-f2bb3842d331 req-02320dd6-a5be-406d-bb30-b33879021efe tempest-ServersNegativeTestJSON-196663710 tempest-ServersNegativeTestJSON-196663710-project-member] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1298.451457] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1298.451612] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 with Priority: HIGH for action security_group_rules [ 1298.451715] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e6206b-217a-495f-93c5-643d3576e725 with Priority: HIGH for action security_group_rules [ 1298.451864] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530d93d3-1148-4ef5-af5b-5267dece0166 with Priority: HIGH for action security_group_rules [ 1298.452171] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f35a35-0102-4d28-a65d-3999b6041978 with Priority: HIGH for action security_group_rules [ 1298.452171] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c74220d-3082-48cf-9655-7a8161bde38f with Priority: HIGH for action security_group_rules [ 1298.452171] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc with Priority: HIGH for action security_group_rules [ 1298.452322] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0fa044-c782-451f-a03f-5161e22ff3ca with Priority: HIGH for action security_group_rules [ 1298.452322] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d196335c-3d4b-49d3-91d2-49ab0c720654 with Priority: HIGH for action security_group_rules [ 1298.452397] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e with Priority: HIGH for action security_group_rules [ 1298.452445] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 with Priority: HIGH for action security_group_rules [ 1298.452528] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 with Priority: HIGH for action security_group_rules [ 1298.452620] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d with Priority: HIGH for action security_group_rules [ 1298.452695] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9687b7d1-a464-4878-ae3a-b131f314c98b with Priority: HIGH for action security_group_rules [ 1298.452781] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 with Priority: HIGH for action security_group_rules [ 1298.452865] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961e8451-f48b-412a-8046-631c24d72fe5 with Priority: HIGH for action security_group_rules [ 1298.452949] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c with Priority: HIGH for action security_group_rules [ 1298.453045] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 with Priority: HIGH for action security_group_rules [ 1298.453132] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d86ff68-550b-40c3-8567-854372ec34de with Priority: HIGH for action security_group_rules [ 1298.453814] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9844dc2-a792-4762-9b70-e918899f67f5 with Priority: HIGH for action security_group_rules [ 1298.453955] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 with Priority: HIGH for action security_group_rules [ 1298.454264] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.454529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.454529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.455254] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.455434] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.455572] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.455645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.455824] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.455911] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.456031] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.456925] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02e933d1-ac0d-4baa-9da0-e149762ce926 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.457058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.457147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.457316] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.457612] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02e933d1-ac0d-4baa-9da0-e149762ce926',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.458311] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3e6206b-217a-495f-93c5-643d3576e725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.458426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.458490] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.458641] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.459329] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3e6206b-217a-495f-93c5-643d3576e725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.460281] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-530d93d3-1148-4ef5-af5b-5267dece0166 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.460281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.460406] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.460656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.460656] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('530d93d3-1148-4ef5-af5b-5267dece0166',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.461508] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32f35a35-0102-4d28-a65d-3999b6041978 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.461508] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.461617] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.461715] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.461754] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32f35a35-0102-4d28-a65d-3999b6041978',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.462428] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c74220d-3082-48cf-9655-7a8161bde38f taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.462612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.462612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.463304] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.463304] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c74220d-3082-48cf-9655-7a8161bde38f',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.464523] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.464523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.464523] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.464707] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.464748] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19c6e48f-d229-4770-b4c7-fb4b77bd07bc',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.465973] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be0fa044-c782-451f-a03f-5161e22ff3ca taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.466099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.466141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.466738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.466817] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be0fa044-c782-451f-a03f-5161e22ff3ca',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.468555] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d196335c-3d4b-49d3-91d2-49ab0c720654 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.468555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.468555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.468555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.468555] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d196335c-3d4b-49d3-91d2-49ab0c720654',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.468775] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.469224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.469509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.469592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.469928] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('433b7d9d-3978-4af8-a278-70a89b5d5f2e',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.470746] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cf83cc4-cb38-45ef-a793-74322cc1b712 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.470871] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.470952] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.471108] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.471232] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cf83cc4-cb38-45ef-a793-74322cc1b712',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.472886] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aec1e262-a46a-4ce5-b4f8-1392575d0891 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.472886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.472886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.472886] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.472886] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aec1e262-a46a-4ce5-b4f8-1392575d0891',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.474224] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.474224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.474801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.474983] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.475086] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ed86dd0-f355-4dc0-9bd4-91be15af4d6d',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.476560] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9687b7d1-a464-4878-ae3a-b131f314c98b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.476560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.476560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.476722] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.476722] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9687b7d1-a464-4878-ae3a-b131f314c98b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.477366] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.477492] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.477564] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.477981] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.477981] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c6b2ecc-4e9d-4daa-827c-44b5af68a366',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.478775] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-961e8451-f48b-412a-8046-631c24d72fe5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.478775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.478775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.478775] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.478775] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('961e8451-f48b-412a-8046-631c24d72fe5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.480257] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d205434-5ee2-4e1a-bee3-e65c424f311c taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.480257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.480257] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.480603] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.480603] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d205434-5ee2-4e1a-bee3-e65c424f311c',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.482431] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50c43a13-ebd7-47b2-924e-039a5d7a4354 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.482431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.482431] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.482598] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.482754] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50c43a13-ebd7-47b2-924e-039a5d7a4354',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.484026] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d86ff68-550b-40c3-8567-854372ec34de taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.484026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.484026] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.484189] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.484223] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d86ff68-550b-40c3-8567-854372ec34de',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.485920] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9844dc2-a792-4762-9b70-e918899f67f5 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.486244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.486321] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.486520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.486588] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9844dc2-a792-4762-9b70-e918899f67f5',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.488014] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57fdce9f-904c-425a-b6d4-0a58e3578508 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.488014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.488140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.488208] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.488279] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57fdce9f-904c-425a-b6d4-0a58e3578508',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.519816] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.520068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.520141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.520355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.540172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.540284] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aec1e262-a46a-4ce5-b4f8-1392575d0891 is going to be deleted. [ 1298.593179] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.593397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.593397] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.593596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.593690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.593807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aec1e262-a46a-4ce5-b4f8-1392575d0891" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.784306] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.784496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.784753] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.785765] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.786012] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.786248] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.786404] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.786673] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.786837] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.787079] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1298.787197] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1298.787307] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1298.787440] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1298.787595] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1298.787717] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1298.787825] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1298.808200] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1298.808363] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1298.808504] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1298.808679] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.809204] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-b94aeea9-631e-4251-8f49-5637e5474b9b taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.809204] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-b94aeea9-631e-4251-8f49-5637e5474b9b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.809380] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-b94aeea9-631e-4251-8f49-5637e5474b9b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.809736] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-b94aeea9-631e-4251-8f49-5637e5474b9b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.809877] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b94aeea9-631e-4251-8f49-5637e5474b9b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.996845] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.005970] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.006114] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.006187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.006382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.014833] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.014985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.053201] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.053412] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.054879] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.055091] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cf83cc4-cb38-45ef-a793-74322cc1b712 is going to be deleted. [ 1299.060521] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.060869] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.063455] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.063710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.067209] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.067376] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.071114] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.071271] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.072744] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.073015] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.074016] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.074176] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.075182] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.075315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.076345] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.076484] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.077508] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.077670] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.081866] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.081988] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.082855] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.082949] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.085195] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.085747] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.085889] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.086718] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.087277] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.087389] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.089651] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.090238] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.090238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.097288] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.097828] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.097927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.098646] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.099024] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.099138] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.099998] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.100187] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.100278] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.106774] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1299.107269] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.107419] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ed86dd0-f355-4dc0-9bd4-91be15af4d6d is going to be deleted. [ 1299.108302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.108509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.129039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.129191] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 530d93d3-1148-4ef5-af5b-5267dece0166 is going to be deleted. [ 1299.130157] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.130363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.149139] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.149292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.151590] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.151708] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9687b7d1-a464-4878-ae3a-b131f314c98b is going to be deleted. [ 1299.152662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.152808] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.177592] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.177738] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 433b7d9d-3978-4af8-a278-70a89b5d5f2e is going to be deleted. [ 1299.178620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.178827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.192274] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.192470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.198145] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.198350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.228142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.228302] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02e933d1-ac0d-4baa-9da0-e149762ce926 is going to be deleted. [ 1299.229206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.229420] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.240095] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.240281] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.281332] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.281537] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.297266] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.297483] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3e6206b-217a-495f-93c5-643d3576e725 is going to be deleted. [ 1299.298841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.298841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.311704] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.311910] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.312269] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.312444] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.312566] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.312845] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.312993] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.313182] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port b94aeea9-631e-4251-8f49-5637e5474b9b not found, creating... [ 1299.313432] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.313585] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.313702] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.313929] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.314080] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.314353] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.314505] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.314621] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.314822] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.314951] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.315101] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: b94aeea9-631e-4251-8f49-5637e5474b9b is going to be created. [ 1299.341989] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.342172] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9844dc2-a792-4762-9b70-e918899f67f5 is going to be deleted. [ 1299.343082] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.343300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.399947] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.400206] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.400317] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.400612] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.400866] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.401113] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-b94aeea9-631e-4251-8f49-5637e5474b9b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.431917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.432110] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d196335c-3d4b-49d3-91d2-49ab0c720654 is going to be deleted. [ 1299.433029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.433245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.452397] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.452786] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.461548] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.461689] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c74220d-3082-48cf-9655-7a8161bde38f is going to be deleted. [ 1299.462600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.462812] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.504887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.505085] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19c6e48f-d229-4770-b4c7-fb4b77bd07bc is going to be deleted. [ 1299.506020] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.506245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.509007] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.579112] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.579112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.581230] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.581345] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.587055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.587192] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50c43a13-ebd7-47b2-924e-039a5d7a4354 is going to be deleted. [ 1299.588314] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.588506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.647078] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.647219] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c6b2ecc-4e9d-4daa-827c-44b5af68a366 is going to be deleted. [ 1299.648165] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.648421] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.676482] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.676645] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.732422] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.732619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.736621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.736745] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be0fa044-c782-451f-a03f-5161e22ff3ca is going to be deleted. [ 1299.737663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.737951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.750784] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.750970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.782887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.783081] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32f35a35-0102-4d28-a65d-3999b6041978 is going to be deleted. [ 1299.784198] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.784424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.842945] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.843116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.868574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.868574] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d205434-5ee2-4e1a-bee3-e65c424f311c is going to be deleted. [ 1299.869409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.869673] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.892627] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.892780] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.925473] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.925621] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 961e8451-f48b-412a-8046-631c24d72fe5 is going to be deleted. [ 1299.926797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.927121] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.953217] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.953217] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.984110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.984110] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57fdce9f-904c-425a-b6d4-0a58e3578508 is going to be deleted. [ 1299.984110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.984110] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.011929] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.011929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.012188] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.012418] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.012566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.012746] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 is going to be updated. [ 1300.016152] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.016360] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.055914] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.056079] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d86ff68-550b-40c3-8567-854372ec34de is going to be deleted. [ 1300.057045] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.057300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.057483] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.057596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cf83cc4-cb38-45ef-a793-74322cc1b712" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.057784] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.057976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.058116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.058260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ed86dd0-f355-4dc0-9bd4-91be15af4d6d" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.058798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.059040] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.059169] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.059322] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-530d93d3-1148-4ef5-af5b-5267dece0166" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.059525] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.059737] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.059847] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.059990] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9687b7d1-a464-4878-ae3a-b131f314c98b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.060166] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.060441] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.060677] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.060826] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-433b7d9d-3978-4af8-a278-70a89b5d5f2e" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.061587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.061587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.061587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.061587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02e933d1-ac0d-4baa-9da0-e149762ce926" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.061587] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.061801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.061801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.061877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3e6206b-217a-495f-93c5-643d3576e725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.061994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.062150] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.062226] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.062340] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d196335c-3d4b-49d3-91d2-49ab0c720654" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.062467] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.062606] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.062681] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.062796] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9844dc2-a792-4762-9b70-e918899f67f5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.062996] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.063052] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.063132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.063236] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c74220d-3082-48cf-9655-7a8161bde38f" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.063355] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.063494] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.063566] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.063676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19c6e48f-d229-4770-b4c7-fb4b77bd07bc" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.063797] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.064023] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.064112] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.064224] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50c43a13-ebd7-47b2-924e-039a5d7a4354" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.064408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.064478] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.064552] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.064662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c6b2ecc-4e9d-4daa-827c-44b5af68a366" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.064807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.064947] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.065029] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.065140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be0fa044-c782-451f-a03f-5161e22ff3ca" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.065338] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.065482] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.065555] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.065764] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32f35a35-0102-4d28-a65d-3999b6041978" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.065902] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.066054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.066128] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.066234] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d205434-5ee2-4e1a-bee3-e65c424f311c" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.082608] env[65678]: INFO networking_nsxv3.common.synchronization [req-b5cf33e5-c445-48c1-b40b-f2bb3842d331 req-d54979f6-65cd-4202-9e4e-911c5d25b2a9 service nova] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_rules [ 1300.082862] env[65678]: INFO networking_nsxv3.common.synchronization [req-b5cf33e5-c445-48c1-b40b-f2bb3842d331 req-d54979f6-65cd-4202-9e4e-911c5d25b2a9 service nova] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1300.083026] env[65678]: INFO networking_nsxv3.common.synchronization [req-b5cf33e5-c445-48c1-b40b-f2bb3842d331 req-d54979f6-65cd-4202-9e4e-911c5d25b2a9 service nova] Enqueued Resource ID: b94aeea9-631e-4251-8f49-5637e5474b9b with Priority: HIGHEST for action port [ 1300.083639] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_rules [ 1300.083781] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1300.083876] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b94aeea9-631e-4251-8f49-5637e5474b9b with Priority: HIGHEST for action port [ 1300.084962] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.085105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.085173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.085371] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.085513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.087300] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.087300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.087300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.087300] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.087300] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.088424] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.088424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.088424] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-b94aeea9-631e-4251-8f49-5637e5474b9b taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.088736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b94aeea9-631e-4251-8f49-5637e5474b9b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.088736] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b94aeea9-631e-4251-8f49-5637e5474b9b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.088849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b94aeea9-631e-4251-8f49-5637e5474b9b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.088849] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b94aeea9-631e-4251-8f49-5637e5474b9b',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.103601] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: IN_PROGRESS for 2s [ 1300.115711] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.115904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.115904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.116116] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.116213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.116339] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-961e8451-f48b-412a-8046-631c24d72fe5" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.140154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.140362] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.140411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.140672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.140789] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.140926] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57fdce9f-904c-425a-b6d4-0a58e3578508" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.182259] env[65678]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.182790] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.182933] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.183028] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.183239] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.183332] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.183451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d86ff68-550b-40c3-8567-854372ec34de" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.591925] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.591925] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.592368] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b94aeea9-631e-4251-8f49-5637e5474b9b with status ACTIVE [ 1300.592368] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.592447] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.592575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.592740] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.592827] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.593017] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.593137] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.593199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.593363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.593452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.593635] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.593727] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.593788] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.593927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.593999] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.594093] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b94aeea9-631e-4251-8f49-5637e5474b9b is going to be updated. [ 1300.616668] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.616856] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.616856] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.616994] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.617140] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.617296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b94aeea9-631e-4251-8f49-5637e5474b9b" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.114852] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: SUCCESS [ 1302.115238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.115238] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.115451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.115641] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.115762] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.115832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.115987] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.116084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.116184] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.618798] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.121073] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.624017] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.624214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.624214] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.624387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.624501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.624572] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 is going to be updated. [ 1303.651600] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.651772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.651772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.651985] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.652142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.661928] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: IN_PROGRESS for 2s [ 1305.085257] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.085679] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1305.673598] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: SUCCESS [ 1305.673860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.673959] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.674199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.674384] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.674513] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.674586] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.674703] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.674773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.674860] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.674946] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.177576] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.177993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.177993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.177993] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.178200] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.178270] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.178320] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.178470] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.178557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.178644] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.178827] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.179039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.179039] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.179199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.179270] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.179359] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.179433] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.179500] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.179612] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.179689] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.179794] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.682177] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd928ece-5917-427b-90dc-a2f5eb4dc3c8: rpc.has_security_group_logging(os_id): False [ 1306.703084] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.703329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.703329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.703515] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.725296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.725572] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.725723] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.725800] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.726011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.726117] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.726364] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.726475] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.726538] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.726716] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.726798] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.727028] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.727147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.727229] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.727390] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.727499] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.727608] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 is going to be updated. [ 1306.788876] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.789187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.789187] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.789398] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.789559] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.802918] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: IN_PROGRESS for 2s [ 1308.781884] env[65678]: INFO networking_nsxv3.common.synchronization [req-3dd7b771-a185-4af0-ad28-048a244db11f req-33862bfb-deba-4525-98c9-4e2bd11919ef tempest-ServerActionsTestOtherB-194906544 tempest-ServerActionsTestOtherB-194906544-project-member] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1308.782514] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1308.782879] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.783054] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.783155] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.783387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.783640] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.783801] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.784036] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.784095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.784260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.784384] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.819165] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: SUCCESS [ 1308.819395] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.287137] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.287414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.287414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.287570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.312426] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.312692] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.312831] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.312883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.313096] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.313174] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.313264] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1309.342376] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.342720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.342720] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.342851] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.342899] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.351330] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1309.954465] env[65678]: INFO networking_nsxv3.common.synchronization [req-8e9b8180-984b-415a-af8c-7ee1a95b10ad req-32472b79-33c4-44d2-858b-55e418cb4f78 tempest-ServersNegativeTestJSON-196663710 tempest-ServersNegativeTestJSON-196663710-project-member] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1309.954735] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1309.955031] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.955158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.955225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.955415] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.955558] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.955655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.955713] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.955855] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.955938] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.956156] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.459955] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.961562] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.362201] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1311.362372] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 deletion is rescheduled due to dependency. [ 1311.362423] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.463226] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.463462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.463462] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.463648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.463739] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.463840] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 is going to be updated. [ 1311.491163] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.491329] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.491380] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.491570] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.491712] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.500683] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: IN_PROGRESS for 2s [ 1313.512359] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: SUCCESS [ 1313.512663] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.956198] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.956565] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1316.097924] env[65678]: INFO networking_nsxv3.common.synchronization [req-d2aca055-6ecf-4313-8128-b9093e538e1f req-4d00a536-73b5-4751-bcac-8f34e3dea6f5 tempest-ServerActionsTestOtherB-194906544 tempest-ServerActionsTestOtherB-194906544-project-member] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1316.097924] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1316.097924] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.097924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.097924] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.098344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.098344] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.098344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.098344] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.098509] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.098591] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.098683] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.421488] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock network-773 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.421713] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.421838] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.422171] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.422438] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.422597] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.422713] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.422930] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.423098] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.423362] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1316.423487] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1316.423599] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1316.423706] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1316.423816] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1316.423919] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1316.424078] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1316.445149] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1316.445316] env[65678]: DEBUG dogpile.cache.region [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1316.445446] env[65678]: DEBUG dogpile.lock [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1316.445636] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.445976] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock port-fcd91280-c84c-471f-bf84-585f3f2aa2c0 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.446357] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "port-fcd91280-c84c-471f-bf84-585f3f2aa2c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.446357] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "port-fcd91280-c84c-471f-bf84-585f3f2aa2c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.446592] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "port-fcd91280-c84c-471f-bf84-585f3f2aa2c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.446729] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd91280-c84c-471f-bf84-585f3f2aa2c0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.600971] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.601260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.601363] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.601597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.601746] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.602031] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.602199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.602309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.602526] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.602650] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.602811] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1316.631353] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.631574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.631574] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.631738] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.631875] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.641853] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1316.949310] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.949541] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.949589] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.949925] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.950092] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.950254] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Segment Port fcd91280-c84c-471f-bf84-585f3f2aa2c0 not found, creating... [ 1316.950508] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.950661] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.950780] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.951068] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.951186] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.951458] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.951609] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.951723] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.951924] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.952071] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.952207] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Resource: SegmentPort with ID: fcd91280-c84c-471f-bf84-585f3f2aa2c0 is going to be created. [ 1316.973613] env[65678]: DEBUG networking_nsxv3.common.locking [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.973840] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.973920] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.974196] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.974414] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.974630] env[65678]: DEBUG oslo_concurrency.lockutils [None req-f1a52fe7-051e-49a0-be55-35107f2a677a None None] Releasing lock "port-fcd91280-c84c-471f-bf84-585f3f2aa2c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.664997] env[65678]: INFO networking_nsxv3.common.synchronization [req-d2aca055-6ecf-4313-8128-b9093e538e1f req-306c30bf-7402-4a2b-a9e9-6a7c790f43a9 service nova] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1317.665485] env[65678]: INFO networking_nsxv3.common.synchronization [req-d2aca055-6ecf-4313-8128-b9093e538e1f req-306c30bf-7402-4a2b-a9e9-6a7c790f43a9 service nova] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1317.665485] env[65678]: INFO networking_nsxv3.common.synchronization [req-d2aca055-6ecf-4313-8128-b9093e538e1f req-306c30bf-7402-4a2b-a9e9-6a7c790f43a9 service nova] Enqueued Resource ID: fcd91280-c84c-471f-bf84-585f3f2aa2c0 with Priority: HIGHEST for action port [ 1317.665904] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1317.666162] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1317.666364] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcd91280-c84c-471f-bf84-585f3f2aa2c0 with Priority: HIGHEST for action port [ 1317.666837] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.666837] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.666971] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.667216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.667362] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.668898] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.669055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.669308] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcd91280-c84c-471f-bf84-585f3f2aa2c0 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.669486] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcd91280-c84c-471f-bf84-585f3f2aa2c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.669579] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcd91280-c84c-471f-bf84-585f3f2aa2c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.669862] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcd91280-c84c-471f-bf84-585f3f2aa2c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.669982] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd91280-c84c-471f-bf84-585f3f2aa2c0',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.172160] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.172328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.172476] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcd91280-c84c-471f-bf84-585f3f2aa2c0 with status ACTIVE [ 1318.172649] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.172767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.172841] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.173099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.173220] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.173406] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.173506] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.173565] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.173725] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.173804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.173987] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.174118] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.174158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.174296] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.174387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.174444] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcd91280-c84c-471f-bf84-585f3f2aa2c0 is going to be updated. [ 1318.197183] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.197452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.197452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.197668] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.197767] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.197939] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcd91280-c84c-471f-bf84-585f3f2aa2c0" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.651450] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1318.651627] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 deletion is rescheduled due to dependency. [ 1318.651741] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.651912] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.652230] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.652416] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.652531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.652597] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.652748] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.652830] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.652925] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.154862] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.657956] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.160592] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.160961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.160961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.161144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.161233] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.161336] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1320.190090] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.190244] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.190301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.190503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.190672] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.201677] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1322.224648] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1322.224909] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.225056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.225273] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.225471] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.225616] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.225675] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.225803] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.225880] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.225967] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.226072] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.667435] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.667552] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1322.729158] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.232548] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8edd9-578b-4843-bee9-3ea3ba7e5469: rpc.has_security_group_logging(os_id): False [ 1323.251924] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.252142] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.252225] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.252453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.252573] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.252795] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.252898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.252964] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.253125] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.253202] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.253289] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1323.314648] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.314927] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.315090] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.315424] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.315690] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.331507] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1325.346962] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1325.347305] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.669421] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.669421] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.670435] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1332.670786] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.671607] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.672044] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.672658] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.672983] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.673746] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.674161] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.493841] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.494199] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.494199] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.494456] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.494698] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.494852] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.494966] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.495186] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.495357] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.495582] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1350.495696] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1350.495807] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1350.495915] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1350.496033] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1350.496139] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1350.496270] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1350.518442] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1350.518632] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1350.518737] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1350.518907] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-347" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.519236] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-fcf3f60e-abd8-4304-a6db-a11c6b63a725 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.519413] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.519530] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.519785] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.519919] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcf3f60e-abd8-4304-a6db-a11c6b63a725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.022690] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.022950] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.023046] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.023382] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.023551] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.023841] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.024010] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.024133] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.024356] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.024496] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.024773] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.024927] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.025058] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.025271] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.025403] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.025543] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: fcf3f60e-abd8-4304-a6db-a11c6b63a725 is going to be updated. [ 1351.048347] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.048570] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.048708] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.048937] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.049198] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.049437] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.713533] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca162a65-80a7-4b49-99c8-0d8586733e0f req-32ace034-58e0-4425-a048-9ffbfb082618 service nova] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_rules [ 1351.713816] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca162a65-80a7-4b49-99c8-0d8586733e0f req-32ace034-58e0-4425-a048-9ffbfb082618 service nova] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1351.713856] env[65678]: INFO networking_nsxv3.common.synchronization [req-ca162a65-80a7-4b49-99c8-0d8586733e0f req-32ace034-58e0-4425-a048-9ffbfb082618 service nova] Enqueued Resource ID: fcf3f60e-abd8-4304-a6db-a11c6b63a725 with Priority: HIGHEST for action port [ 1351.714358] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_rules [ 1351.714498] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1351.714742] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcf3f60e-abd8-4304-a6db-a11c6b63a725 with Priority: HIGHEST for action port [ 1351.714865] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.714984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.715285] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.715556] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.715676] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.717271] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.717402] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.717480] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.718058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.718058] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.718058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.718058] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.718312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.718312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.718312] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.719093] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcf3f60e-abd8-4304-a6db-a11c6b63a725 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.721286] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.721404] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.721626] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.721626] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcf3f60e-abd8-4304-a6db-a11c6b63a725',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.218251] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.218493] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.222752] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.223781] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcf3f60e-abd8-4304-a6db-a11c6b63a725 with status ACTIVE [ 1352.224058] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.224206] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.224276] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.224546] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.224613] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.224771] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.224883] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.224977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.225154] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.225852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.225852] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.225852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.225852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.225852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.225852] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.226136] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcf3f60e-abd8-4304-a6db-a11c6b63a725 is going to be updated. [ 1352.248847] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.249081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.249081] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.249260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.249393] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.249553] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcf3f60e-abd8-4304-a6db-a11c6b63a725" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.727715] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.230401] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.230662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.230662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.230884] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.230975] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.231093] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 is going to be updated. [ 1353.264298] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.264520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.264520] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.264666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.264811] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.275027] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: IN_PROGRESS for 2s [ 1355.285519] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: SUCCESS [ 1355.285907] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.285950] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.286391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.286391] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.286547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.286620] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.286772] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.286861] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.286955] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.287153] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.789463] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.789766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.789766] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.789937] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.790098] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.790199] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.790245] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.790438] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.790531] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.790621] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.790791] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.790874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.790928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.791084] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.791220] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.791311] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.791369] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.791518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.791596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.791671] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.791761] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.294544] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd928ece-5917-427b-90dc-a2f5eb4dc3c8: rpc.has_security_group_logging(os_id): False [ 1356.312859] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.313119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.313119] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.313298] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.313391] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.313634] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.313758] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.313814] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.313977] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.314068] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.314270] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.314408] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.314474] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.314648] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.314730] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.314935] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.315048] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.315143] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.315328] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.315453] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.315600] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 is going to be updated. [ 1356.389191] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.389451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.389451] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.389652] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.389858] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.406339] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: IN_PROGRESS for 2s [ 1356.715827] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.716050] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1358.428067] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: SUCCESS [ 1358.428501] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.716904] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.717434] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.717889] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.718277] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.719260] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.719693] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.720335] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.720690] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.364240] env[65678]: INFO networking_nsxv3.common.synchronization [req-19ec0068-c626-4952-84de-30fcf7744307 req-e4182ef9-1764-4336-9da5-2a5afaf4e1d0 tempest-ServersNegativeTestJSON-196663710 tempest-ServersNegativeTestJSON-196663710-project-member] Enqueued Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1378.364684] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 with Priority: HIGHEST for action security_group_members [ 1378.364997] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.365133] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.365197] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.365543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.365543] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.365656] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.365694] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.365958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.365958] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.365958] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd928ece-5917-427b-90dc-a2f5eb4dc3c8',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.867688] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.867844] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.867917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.868151] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.868243] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.868432] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.868530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.868595] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.868747] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.868832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.868917] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 is going to be updated. [ 1378.901192] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.901192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.901192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.901192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.901192] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.909377] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: IN_PROGRESS for 2s [ 1380.923950] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 in Status: SUCCESS [ 1380.924387] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd928ece-5917-427b-90dc-a2f5eb4dc3c8 deletion is rescheduled due to dependency. [ 1380.924387] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd928ece-5917-427b-90dc-a2f5eb4dc3c8" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.365816] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.366120] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.367695] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.368092] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.369194] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.369194] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.370476] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.370855] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.371547] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.371936] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.372620] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.373110] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.373448] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.373754] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.212067] env[65678]: INFO networking_nsxv3.common.synchronization [req-c07281c4-340f-4b65-829e-90c8e555e84b req-d46bbe4f-73fc-4006-8770-94b386fba2c1 tempest-ServerActionsTestOtherB-194906544 tempest-ServerActionsTestOtherB-194906544-project-member] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1414.212193] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1414.212874] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.212874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.212874] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.213144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.213144] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.213312] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.213373] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.213529] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.213619] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.213715] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.716166] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.716600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.716600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.716600] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.716719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.716893] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.717032] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.717099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.717213] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.717288] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.717376] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1414.745924] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.746221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.746221] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.746337] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.746469] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.755380] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1416.766798] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1416.767246] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 deletion is rescheduled due to dependency. [ 1416.767246] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.213600] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.213968] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.251288] env[65678]: INFO networking_nsxv3.common.synchronization [req-7602f729-cd07-415f-940d-d5907e879da3 req-c6e88445-270a-4777-a6df-1a79c89b67bf tempest-ServerActionsTestOtherB-194906544 tempest-ServerActionsTestOtherB-194906544-project-member] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1422.251949] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1422.252458] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.252458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.252458] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.252589] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.252705] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.252804] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.252892] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.253158] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.253258] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.253383] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.537080] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-773 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.537312] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.537468] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.537745] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.538027] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.538213] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.538332] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.538548] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.538691] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.538898] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1422.539027] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1422.539139] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1422.539249] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1422.539359] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1422.539462] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1422.539591] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1422.560210] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1422.560400] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1422.560499] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1422.560666] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.560967] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-d2bca90b-89f1-44d3-ab83-eaaa9d930627 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.561180] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.561315] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.561642] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.561784] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2bca90b-89f1-44d3-ab83-eaaa9d930627',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.755906] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.756139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.756139] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.756334] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.756429] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.756620] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.756718] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.756782] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.756929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.757014] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.757100] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1422.783458] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.783655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.783655] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.783825] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.783961] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.792136] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1423.064066] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.064273] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.064320] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.064625] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.064802] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.064982] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Segment Port d2bca90b-89f1-44d3-ab83-eaaa9d930627 not found, creating... [ 1423.065295] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.065475] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.065615] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.065865] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.066026] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.066365] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.066537] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.066684] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.066918] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.067083] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.067261] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: d2bca90b-89f1-44d3-ab83-eaaa9d930627 is going to be created. [ 1423.093096] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.093449] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.093657] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.094109] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.094477] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.094803] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.786157] env[65678]: INFO networking_nsxv3.common.synchronization [req-7602f729-cd07-415f-940d-d5907e879da3 req-3f5b63e9-a782-43f2-9ef2-4d3dba77a329 service nova] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1423.786157] env[65678]: INFO networking_nsxv3.common.synchronization [req-7602f729-cd07-415f-940d-d5907e879da3 req-3f5b63e9-a782-43f2-9ef2-4d3dba77a329 service nova] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1423.786157] env[65678]: INFO networking_nsxv3.common.synchronization [req-7602f729-cd07-415f-940d-d5907e879da3 req-3f5b63e9-a782-43f2-9ef2-4d3dba77a329 service nova] Enqueued Resource ID: d2bca90b-89f1-44d3-ab83-eaaa9d930627 with Priority: HIGHEST for action port [ 1423.786622] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1423.786622] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1423.786622] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2bca90b-89f1-44d3-ab83-eaaa9d930627 with Priority: HIGHEST for action port [ 1423.787103] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.787191] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.787260] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.787454] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.787538] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.788433] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.788557] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.788777] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2bca90b-89f1-44d3-ab83-eaaa9d930627 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.788887] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.788951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.789144] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.789238] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2bca90b-89f1-44d3-ab83-eaaa9d930627',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.291537] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.291779] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.291902] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2bca90b-89f1-44d3-ab83-eaaa9d930627 with status ACTIVE [ 1424.292156] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.292284] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.292411] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.292753] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.292806] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.293012] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.293228] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.293310] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.293530] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.293610] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.293821] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.293922] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.294011] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.294173] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.294251] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.294337] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2bca90b-89f1-44d3-ab83-eaaa9d930627 is going to be updated. [ 1424.317446] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.317676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.317676] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.317853] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.317992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.318172] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.803649] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1424.804046] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 deletion is rescheduled due to dependency. [ 1424.804046] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.804179] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.804309] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.804492] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.804596] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.804662] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.804813] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.804897] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.804983] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.307800] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.809775] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.313409] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.313594] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.313666] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.313919] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.314035] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.314134] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1426.343133] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.343301] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.343348] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.343560] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.343700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.351984] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1428.364152] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1428.364599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.364599] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.364691] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.364866] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.364984] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.365055] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.365216] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.365297] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.365382] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.365472] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.787308] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.787547] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1428.868052] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.370921] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8edd9-578b-4843-bee9-3ea3ba7e5469: rpc.has_security_group_logging(os_id): False [ 1429.389992] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.390218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.390218] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.390440] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.390518] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.390771] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.390877] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.390941] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.391201] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.391302] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.391398] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1429.450592] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.450805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.450805] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.450953] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.451105] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.465181] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1431.480490] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1431.481043] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.789072] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.789072] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.789990] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.789990] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.790911] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.791292] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.791792] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.792275] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.792759] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.793191] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.793932] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.794476] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.794826] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.795229] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.796613] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.796613] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.797220] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.797612] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1478.798783] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1478.798783] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1483.800087] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.800412] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1488.800779] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.801173] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.801394] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.801671] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.896589] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock network-773 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.896807] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.896937] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.897226] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.897482] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.897653] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.897800] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.898044] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.898200] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.898414] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1493.898532] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] NeedRegenerationException {{(pid=65678) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1493.898644] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] no value, waiting for create lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1493.898754] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] value creation lock acquired {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1493.898865] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] No value present for key: 'zone-id' {{(pid=65678) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1493.898972] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Calling creation function for not-yet-present value {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1493.899127] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1493.925685] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1493.925870] env[65678]: DEBUG dogpile.cache.region [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65678) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1493.925997] env[65678]: DEBUG dogpile.lock [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Released creation lock {{(pid=65678) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1493.926194] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "network-773" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.926501] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock port-d2bca90b-89f1-44d3-ab83-eaaa9d930627 taken with stack trace [, , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1493.926670] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1493.926791] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1493.927061] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1493.927200] env[65678]: DEBUG networking_nsxv3.api.rpc [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2bca90b-89f1-44d3-ab83-eaaa9d930627',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.429856] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.430144] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.430207] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.430489] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.430638] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.430925] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.431105] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.431226] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.431449] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.431584] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.431886] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.432068] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.432192] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.432400] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.432544] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.432700] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Resource: SegmentPort with ID: d2bca90b-89f1-44d3-ab83-eaaa9d930627 is going to be updated. [ 1494.454024] env[65678]: DEBUG networking_nsxv3.common.locking [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.454239] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.454362] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.454657] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.454866] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.455096] env[65678]: DEBUG oslo_concurrency.lockutils [None req-1bf42a0e-572b-41ea-bebd-35534254bc20 None None] Releasing lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.116032] env[65678]: INFO networking_nsxv3.common.synchronization [req-9b91b564-59b8-4659-9fc3-7a7843647c57 req-8ebe837b-021e-42da-a68b-64764457fbc1 service nova] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1495.116032] env[65678]: INFO networking_nsxv3.common.synchronization [req-9b91b564-59b8-4659-9fc3-7a7843647c57 req-8ebe837b-021e-42da-a68b-64764457fbc1 service nova] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1495.116032] env[65678]: INFO networking_nsxv3.common.synchronization [req-9b91b564-59b8-4659-9fc3-7a7843647c57 req-8ebe837b-021e-42da-a68b-64764457fbc1 service nova] Enqueued Resource ID: d2bca90b-89f1-44d3-ab83-eaaa9d930627 with Priority: HIGHEST for action port [ 1495.116428] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_rules [ 1495.116428] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1495.116428] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2bca90b-89f1-44d3-ab83-eaaa9d930627 with Priority: HIGHEST for action port [ 1495.116595] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.116728] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.116794] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.116980] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.117101] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.118657] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.118657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.118657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.118657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.118657] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.118657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.118657] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.119163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.119163] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.119163] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.121784] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2bca90b-89f1-44d3-ab83-eaaa9d930627 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.121904] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.121976] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.122147] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.122218] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2bca90b-89f1-44d3-ab83-eaaa9d930627',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.623374] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.624532] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.624636] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.626337] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2bca90b-89f1-44d3-ab83-eaaa9d930627 with status ACTIVE [ 1495.626530] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.626643] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.626710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.626917] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.627024] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.627195] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.627292] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.627353] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.627503] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.627580] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.627756] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.627846] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.627906] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.628056] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.628130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.628212] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2bca90b-89f1-44d3-ab83-eaaa9d930627 is going to be updated. [ 1495.648154] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.648370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.648370] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.648543] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.648726] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.648889] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2bca90b-89f1-44d3-ab83-eaaa9d930627" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.125732] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.627785] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.628027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.628027] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.628191] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.628283] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.628397] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1496.661317] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.661547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.661547] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.661773] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.661970] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.671890] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1498.683702] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1498.684099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.684099] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.684327] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.684533] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.684651] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.684705] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.684849] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.684929] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.685038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.685109] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1498.742481] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1498.742719] env[65678]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d6670653-0a55-4a3c-8faf-aefe7c2fc05b None None] NSXv3 Agent Agent loop - iteration:4 started [ 1499.189569] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1499.692299] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d8edd9-578b-4843-bee9-3ea3ba7e5469: rpc.has_security_group_logging(os_id): False [ 1499.714720] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.714960] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.715088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.715315] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.715413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.715761] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.715898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.716038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.716141] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.716219] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.716327] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1499.780023] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.780365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.780365] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.780575] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.780759] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.797168] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1500.117178] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.117402] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1501.818023] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1501.818452] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.118024] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.118491] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.119685] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.120109] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1511.192156] env[65678]: INFO networking_nsxv3.common.synchronization [req-2513750a-ec6c-4f33-9650-312d3d6ad68e req-7427aba8-0e81-470f-bdbe-2e2fe8ee58b5 tempest-ServerActionsTestOtherB-194906544 tempest-ServerActionsTestOtherB-194906544-project-member] Enqueued Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1511.192786] env[65678]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 with Priority: HIGHEST for action security_group_members [ 1511.193166] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d8edd9-578b-4843-bee9-3ea3ba7e5469 taken with stack trace [, , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.193252] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.193350] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.193510] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.193667] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.193770] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.193832] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.193982] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.194095] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.194177] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d8edd9-578b-4843-bee9-3ea3ba7e5469',) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.699538] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.699706] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.699771] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.700038] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.700130] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.700318] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.700414] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.700477] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.700635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.700710] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.700796] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 is going to be updated. [ 1511.729429] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.729635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.729635] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.729807] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.729951] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.738114] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: IN_PROGRESS for 2s [ 1513.750369] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 in Status: SUCCESS [ 1513.750765] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d8edd9-578b-4843-bee9-3ea3ba7e5469 deletion is rescheduled due to dependency. [ 1513.750765] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d8edd9-578b-4843-bee9-3ea3ba7e5469" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.193763] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1516.194168] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1521.195213] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.195586] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1526.195825] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1526.196264] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1531.197402] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1531.197818] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.690967] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.691409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.691409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.691409] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.691625] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.194389] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.696947] env[65678]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65678) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.199904] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1535.200207] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1535.931437] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.931898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.931898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.931898] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.943263] env[65678]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1535.945577] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.946347] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1535.982270] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.982491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.982491] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.982700] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.996928] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.997775] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1535.997863] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1535.997940] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1536.031477] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.031719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.031719] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.032132] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.032578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.032728] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1536.101288] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.101488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.101488] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.101693] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.101992] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.102290] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1536.175312] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.175550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.175550] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.175739] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.176088] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.176406] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1536.176504] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb', 'be3b7ec3-66f8-4175-9611-636d9a427a3e', 'a3b380ca-ae52-4449-89ca-b2e647b635d9', '4b06f75c-4a15-46fd-8850-579c633c71af', 'e857e4d2-27dd-462e-87df-ee44911ff684', '850ea458-7bc9-41b1-87fe-f961a64609eb', '6f8fce09-ff14-4f78-bcad-d1a722c00977', '0cad1a85-e250-44ba-929f-39b2137bd736', '2164111b-0060-40e2-86c3-edfc4931cb24', '3ca02848-c142-45aa-adca-5a1d75fe5bb6', 'cddb9167-1b9c-4751-8cf3-4f83a593874e', '802af02b-8ef5-41bb-a1fa-3f15ffa69531', '8631425e-c832-4434-9322-1536d9e46bb8', '394e9a35-6053-4366-8c10-efbb3bbed0b9', '4f236cc9-1bc2-44e5-b39b-04c5909837a7', '79cab93f-aae5-467c-88f3-35382c30a4ef', '365d72a1-5a30-4ddf-b653-b2fb3c894c63', '40537b9d-ed59-4875-a8af-108e1322d055', '5b13ea87-a34e-4663-aca7-94955d02166c', 'b634fd1e-f1ec-4189-ac44-9f8fa9578204', '6bf254fe-a02c-4c36-8f89-52a5a801f9b5', '8d58c068-3cf0-4038-b60f-b9591e0abf8a', '58d8edd9-578b-4843-bee9-3ea3ba7e5469', 'dd928ece-5917-427b-90dc-a2f5eb4dc3c8', 'cda39a55-69e8-4fac-bca6-eac8c60627f3', '4bcfce19-b3dc-46b9-a272-88acde866ff3'} {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1536.176652] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1536.197039] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.197249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.197249] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.197443] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.197532] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.197640] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1536.197710] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1536.197779] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1536.198683] env[65678]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1536.198787] env[65678]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1536.283144] env[65678]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65678) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.283413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.283413] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.283536] env[65678]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.284578] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.284821] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1536.284900] env[65678]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65678) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1536.284969] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1536.285048] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1536.285119] env[65678]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1536.285188] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abf5cfb8-3605-48fc-9559-f4fa8fb8a5eb with Priority: HIGH for action security_group_rules [ 1536.285267] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be3b7ec3-66f8-4175-9611-636d9a427a3e with Priority: HIGH for action security_group_rules [ 1536.285328] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3b380ca-ae52-4449-89ca-b2e647b635d9 with Priority: HIGH for action security_group_rules [ 1536.285389] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b06f75c-4a15-46fd-8850-579c633c71af with Priority: HIGH for action security_group_rules [ 1536.285447] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e857e4d2-27dd-462e-87df-ee44911ff684 with Priority: HIGH for action security_group_rules [ 1536.285498] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 850ea458-7bc9-41b1-87fe-f961a64609eb with Priority: HIGH for action security_group_rules [ 1536.285555] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f8fce09-ff14-4f78-bcad-d1a722c00977 with Priority: HIGH for action security_group_rules [ 1536.285610] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cad1a85-e250-44ba-929f-39b2137bd736 with Priority: HIGH for action security_group_rules [ 1536.285664] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2164111b-0060-40e2-86c3-edfc4931cb24 with Priority: HIGH for action security_group_rules [ 1536.285719] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ca02848-c142-45aa-adca-5a1d75fe5bb6 with Priority: HIGH for action security_group_rules [ 1536.285789] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cddb9167-1b9c-4751-8cf3-4f83a593874e with Priority: HIGH for action security_group_rules [ 1536.285838] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 802af02b-8ef5-41bb-a1fa-3f15ffa69531 with Priority: HIGH for action security_group_rules [ 1536.285886] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8631425e-c832-4434-9322-1536d9e46bb8 with Priority: HIGH for action security_group_rules [ 1536.285939] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 394e9a35-6053-4366-8c10-efbb3bbed0b9 with Priority: HIGH for action security_group_rules [ 1536.285996] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4f236cc9-1bc2-44e5-b39b-04c5909837a7 with Priority: HIGH for action security_group_rules [ 1536.286066] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 79cab93f-aae5-467c-88f3-35382c30a4ef with Priority: HIGH for action security_group_rules [ 1536.286128] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 365d72a1-5a30-4ddf-b653-b2fb3c894c63 with Priority: HIGH for action security_group_rules [ 1536.286175] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40537b9d-ed59-4875-a8af-108e1322d055 with Priority: HIGH for action security_group_rules [ 1536.286235] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b13ea87-a34e-4663-aca7-94955d02166c with Priority: HIGH for action security_group_rules [ 1536.286286] env[65678]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b634fd1e-f1ec-4189-ac44-9f8fa9578204 with Priority: HIGH for action security_group_rules [ 1536.286379] env[65678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65678) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}